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Principles  of  display  and  control  design  for  Remotely  Piloted  Vehi¬ 
cles  (RPVs)  were  investigated.  The  difficulties  which  arise  from  lack 
of  kinesthetic  feedback  and  problems  associated  with  communicating  ade¬ 
quate  information  to  the  remote  pilot  were  considered.  Attention  was 
focused  on  the  strike  mission.  A  series  of  experiments  were  conducted 
to  examine  the  pilot/subject's  ability  to  control  the  RPV  in  flight 
and  perform  certain  targeting  maneuvers  under  different  display  and 
control  si tuati ons . 

The  outside-in  mode  of  attitude  display  was  preferred  in  spite  of 
the  pilot's  training  and  experience  with  the  conventional  inside-out 
display.  A  combination  of  these  display  modes  was  found  to  improve 
performance.  The  position  mode  control  stick  was  found  to  be  superior 
to  the  conventional  rate  control  stick.  The  method  of  sensor  mounting 
(stable  platform  vs.  f i xed-to-the-ai rf rame)  resulted  in  different  levels 
of  performance  with  the  various  heads-up  attitude  displays.  Particular 
strategies  were  devised  for  the  effective  use  of  remote  sensor  direct¬ 
ional  control  (slewing)  and  zoom.  Additional  techniques  for  improv¬ 
ing  RPV  performance  and  certain  opportunities  for  further  investigation 
are  identified. 
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INTRODUCTION 


The  research  reported  here  was  based  on  an  unsolicited 
proposal  which  was  accepted  by  the  Hunan  Resources  Research 
Division,  Advanced  Research  Projects  Aqency ,  Department  of 
Defense  and  the  Enqinetrinq  Psycholoqy  Proqrans,  Office  of 
Naval  Research,  I).  S.  Navy.  This  proposal  was  an  outqrowth 
of  previous  studies  performed  by  Decision  Science,  Inc.  in 
modelina  the  human  operator  in  flinht  control,  in  devisinq 
loqical  methods  which  now  forri  the  basis  of  a  computer  pro- 
pram  used  in  support  of  the  Differential  Maneuverinq  Simu¬ 
lator,  Lanqley  Research  Center,  NASA,  and  in  the  analysis  of 
other  aspects  of  military  aircraft  and  weapon  systems. 

The  potential  military  value  of  Remotely  Piloted  Ve¬ 
hicles  (RPVs)  is  recoqnized.  The  desiqn  operation  of  such 
equipment  systems  poses  certain  new  man-machine  problems 
which  must  now  be  resolved.  Extensive  experience  has  al- 
i eady  been  pained  in  the  fliqht  control  of  tarqet  drones 
and  certain  missiles  which  are  equipped  for  remote  televisual 
quidance.  But  the  prospect  of  sophisticated  electronic  de¬ 
fense  measures  and  the  requirement  for  precise  maneuverinq 
aqainst  heavily  defended  tarqets  has  qenerated  a  particular 
interest  in  improvinq  the  displays  and  control  of  the  RPV 
console. 
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Obviously,  much  of  what  has  been  learned  about  the  deslqn 
of  displays  and  controls  for  manned  aircraft  remains  relevant. 
There  is  also  a  considerable  background  of  knowledge  derived 
from  previous  operations  Involving  military  RPVs  (although 
these  were  not  so  named).  Vet  certain  questions  remalr  un¬ 
answered.  These  concern  the  subtle  relationships  which  deter¬ 
mine  figure  versus  ground  discrimination  In  remote  control, 
disorientation,  difficulty  In  handling  a  responsive  vehicle 
without  kinesthetic  feedback,  and  difficulties  due  to  Incom¬ 
plete  telemetry  and  the  potential  effects  of  ECU.  It  Is  neces¬ 
sary  to  consider  the  degree  to  which  data  processing  can  be 
performed  onboard  the  vehicle  In  that  this  affects  the  pro¬ 
cessing  the  human  operator  must  perform  In  his  control  of  the 
mission.  Other  questions  concern  the  Innate  capability  held 
by  the  pilot. 

With  these  questions  In  mind,  this  Investigation  began 
with  a  review  of  alternative  RPV  missions  and  the  general 
principles  of  display  ard  control  design  for  manned  aircraft. 
Attention  was  then  focused  on  the  one-way  strike  mission. 

Later  this  was  enlarqed  to  include  multiple  targets  and  re¬ 
turn  of  the  RPV  for  recovery.  In  this  study  the  control 
station  remained  stationary,  thus  unaffected  by  the  g-forces 
which  might  disturb  the  human  operrtor  If  he  were  situated  In 
another  aircraft  or  aboard  a  ship  while  In  control  of  the  RPV. 

The  Investigation  reported  herein  was  conducted  under 
Contract  No.  N00014-72-C-0196.  It  should  serve  as  a  step 
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toward  Inproved  display  and  control  desion  for  the  above- 
referenced  weapon  systems  and  set  the  staqe  for  further  in- 
vestiqation  of  principles  applicable  to  the  desion  of  dis¬ 


plays  and  controls  for  other  PPV  missions,  includinq  re¬ 
connaissance,  janmlno,  Intelliqence  qatherlnq,  air  super¬ 
iority,  and  so  forth. 
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RLPORT  SUMMARY 


This  investigation  was  intended  to  definitize  certain 
principles  of  display  and  control  desiqn  suitable  for  PPVs 
engaged  in  the  strike  mission.  Such  vehicles  may  deliver  con¬ 
ventional  or  laser  guided  weapons  against  heavily  defended 
targets  then  return  to  friendly  territo ry  for  recovery. 

A  review  of  the  principles  of  disnlay  and  control  de¬ 
sign  suitable  for  manned  aircraft  flight  control  revealed 
the  need  foi  additional  displayed  information  to  overcome 
the  pilot  s  lack  of  immediate  kinesthetic  and  p roor i ocept i ve 
feedback  and  the  potential  limitation  imposed  by  the  commu¬ 
nication  channel  between  the  console  and  the  RPV. 

An  initial  experiment  explored  the  fundamental  princ- 
ples  pertinent  to  the  use  of  attitude  prediction  as  well  as 
modes  of  attitude  display  and  flight  control.  Subjects  of 
different  levels  of  experience  were  evaluated  in  their  per¬ 
formance  of  a  simulated  strike  mission.  This  involved  the 
flight  of  a  conventional  RPV  in  accordance  with  a  scenario 
which  included  descent,  the  effects  of  atmospheric  turbulence, 
video  FCM,  and  a  final  maneuver  to  strike  the  target. 

It  was  determined  that  performance  was  degraded  through  the 
use  of  a  predictive  attitude  display  which  offered  only  infor¬ 
mation  concerning  pitch  and  roll.  The  outside-in  mode  of  dis¬ 
play  was  preferred  hy  almost  all  subjects,  including  those 
holding  significant  piloting  experience.  It  was  equal  in 
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performance  to  the  conventional  inside-out  display.  The  nosi- 
tion  control  stick  (that  is,  wherein  the  attitude  is  in  direct 
correspondence  with  the  control  stick  displacement)  was  found 
superior  to  the  conventional  rate  control  stick. 

Additional  experiments  hased  upon  this  preliminary  know¬ 
ledge  were  then  conducted  within  a  more  realistic  simulation 
of  the  mission,  making  use  of  a  moving  map  and  television 
camera  video  display  generating  technique.  This  simulation 
provided  the  p  i  1  o  t  /  s  u  b  j  e  c  t  with  a  heads-up  view  of  what  might 
be  seen  through  a  televisual  sensor  mounted  in  the  RPV.  Here 
subjects  were  restricted  to  designated  Naval  Aviators.  The 
conventional  attitude  display  indicator  (ADI)  served  as  the 
performance  standard  while  alternative  heads-up  attitude  dis¬ 
plays  were  compared  in  terms  of  mission  perform, ance  criteria. 

As  in  the  preliminary  study  the  outside-in  display  mode 
was  preferred,  the  moving  aircraft  symbol  beinn  easier  to 
interpret  especially  when  used  with  a  rate  control  stick. 
Control  reversals  (error  in  direction  of  initial  control 
movement  to  correct  a  suddenly  imposed  attitude  disturbance) 
were  taken  to  indicate  a  deficiency  n  the  display  design. 

The  inside-out  display  mode  produced  fewer  reversals  in  roll 
while  the  outside-in  mode  produced  fewer  reversals  in  pitch. 
This  led  to  the  conception  of  a  combination  display  which 
presented  roll  attitude  in  an  inside-out  mode  and  pitch 
attitude  in  an  outside-in  mode. 
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This  new  display  was  compared  to  the  conventional  dis¬ 
plays  and  was  fourd  to  be  superior  in  terms  of  the  overall 
frequency  of  control  reversals.  It  was  also  preferred  by  the 
subjects.  Such  a  combination  display  mode  proved  to  he 
particularly  suitable  for  fllqht  control  when  the  sensor  is 
fixed  to  the  RPV  airframe.  The  outside-in  node  is  more 
suited  for  use  with  the  sensor  mounted  on  a  stable  platform. 
Smoothlnq  of  the  aircraft  movement  t> rouqh  the  use  of  a  low 
frequency-pass  display  mountlnq  did  not  offer  any  slqnlfl- 
cant  benefit.  Flxlnq  the  sensor  to  the  airframe  improved 
fllqht  control,  but  mountlnq  the  sensor  on  a  stabilized  plat¬ 
form  aided  performance  of  the  crucial  tarqet  attack  maneuver. 

It  Is  worthwhile  to  consider  switchinq  the  display  func¬ 
tion  from  fixed  mountlnq  to  stabilized  platform  mountinq  dur- 
Inq  the  course  of  the  mission  or  of  using  two  pilots,*  each 
operatlnq  the  RPV  In  a  different  mode  of  performance,  that  Is, 
by  mission  phase. 

Reorlentlnq  the  sensor  (slewinq)  in  two  dimensions  was 
found  to  he  useful.  However,  a  careful  strateqy  in  this 
reqard  was  essential.  Specifically,  sensor  control  should 
not  be  concurrent  with  attitude  control.  Zoom  control  of  the 
sensor  can  be  of  particular  value  provided  a  suitable  strateqy 
is  followed:  Zoom  should  not  be  used  while  slewing.  Zooming- 
In  can  be  used  for  target  Identification  with  zoominq-out 
used  during  the  approach  to  the  tarqet  In  order  to  Improve 
aiming  accuracy. 

*  One  using  a  fixed  sensor,  the  other  using  a  stabilized  sen¬ 
sor,  both  sensors  being  mounted  on  the  same  RPV. 
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Other  problems  pertinent  to  P P V  fllqht  control  were 
examined  through  experimental  procedures,  pilot/subject  in- 
terroqatlon ,  and  a  detailed  review  of  their  simulated  flight 
performance.  The  flndlnqs  of  this  study  should  contribute  to 
the  design  of  displays  and  controls  which  can  be  used  to  en¬ 
sure  effective  strike  mission  performance  by  RPVs  ranging  in 
size  from  mlnl-RPVs  through  conventional  aircraft.  Implica¬ 
tions  for  further  research  are  indicated. 
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Problem  Statement 

After  reviewino  the  qenerally  accepted  principles  of 
display  and  control  desinn  for  manned  aircraft  (as  described 
in  an  appendix  of  the  Second  Semi-Annual  Technical  Report 
submitted  under  this  contract),  attention  was  first  focused 
on  the  need  for  qaininn  qreater  unders tandi nq  of  remote  at¬ 
titude  control.  Should  the  RPVs  attitude  he  presented  in  the 
conventional  manner  (an  inside-out  perspective,  that  is,  hv 
means  of  a  movino  horizon  display)  or  should  the  RPV  pilot 
be  offered  an  outside-in  presentation  (with  the  aircraft 
symbol  movlnn  as  it  would  appear  if  the  pilot  was  always 
on  a  stable  platform  situated  behind  the  aircraft)?* 

A  second  question  concerns  the  laq  in  pilot  response 
when  controllino  an  RPV,  presumably  due  to  his  lack  of 
kinesthetic  sensation**.  A  third  fundamental  consideration 
is  the  type  of  control  mode.  Conventional  aircraft  are 


a t f nHo  hi*  T)any  itud1es  inside-out  versus  outside-in 
attitude  displays  for  manned  aircraft  were  referenced  in 

MnnIir^SItS/??r  tbis  contract .  Althouqh  certain  addi- 
:  ni?('  beJVeen  these  two  extremes  were  noted, 

a  new  and  different  combination  was  conceived  In  this  study. 

anri^unnannerf5^  ill  1 s  Jan!liar  with  the  landinq  of  both  manned 
and  unmanned  full-sized  aircraft  report  that  it  Is  easy  to 

d  stinquish  between  these  two  situations  in  view  of  the  larqer 
errors  durinq  final  approach  committed  by  unmanned  aircraft 
i!1]!1:  be1nq  rernote*  cannot  sense  errors  as  quickly  as  he 

oSU.M.1’*  TS  onbo;rd'  ■  "ere  a,,a1n-  ‘""-e  Has  been  con! 
s  derable  work  demonstratinq  the  value  of  anticlpatorv  dis¬ 
plays  but  not  as  these  pertain  specifically  to  PPVs. 
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controlled  through  a  rate  stick;  that  is,  the  fir.t  deriva¬ 
tive  of  aircraft  angular  novenent  is  deterninod  hy  the  stick 
angular  di spl acencnt  *  The  position  stick  node  of  control 
is  sinpler.  Mere  the  attitude  cf  the  aircraft  is  in  direct 
correspondence  with  the  angular  displacenent  of  the  control 
stick.  Rate  stick  control  is  all-attitude  while  the  posi¬ 
tion  stick  normally  limits  the  range  of  attitudes  the  air¬ 
craft  can  assume.  This  restriction  is  acceptable  for  the 
purpose  of  a  strike  mission. 

In  the  initial  phase  of  the  investigation  there  was 
also  concern  for  the  amount  of  knowledge  and  experience  re¬ 
quired  to  properly  control  RPVs.  This  consideration  grew 
out  of  a  recognition  of  the  high  cost  of  training  pilots 
and  their  scarcity  for  RPV  ass i gnnent, espec i a  11 y  in  times 
of  combat.  It  would  certainly  he  advantaneous  If  personnel 
of  lesser  qualifications  could  equally  well  perform  RPV 
flight  control.  The  first  experiment  therefore  involved  five 
classes  of  pilot/subjects,  ranging  from  naive  through  quali¬ 
fied  ilavy  Attack  Pilots. 

Experimental  Procedure: 

Equipment  was  assembled  and  configured  in  order  to 
simulate  the  dynamics  of  a  typical  RPV  (such  as  the  BQM-34E). 
The  simulation  program  was  written  to  represent  a  typical 
jet-driven  subsonic  drone  in  six  degrees  of  freedom.  This 
program  was  prepared  for  the  EAI  3400  Digital  Computer. 

The  EAI  8B00  Analog  Computer  was  used  to  perform  the  required 

*it  is  recognized  that  rotational  damping  causes  some  satur¬ 
ation  effect  for  large  displacements. 
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coupling  to  the  displays  and  controls.  The  equations  of  notion 
were  solved  in  real-tine  usinq  a  forty  millisecond  frame  rate. 

The  output  at  each  frame  was  three  rotational  and  three  trans¬ 
itional  rate  terms  of  vehicle  motion.  These  rates  were 
integrated  in  real-time  to  provide  the  current  attitude  and 

positional  information  required  for  drivinq  the  disolay  de¬ 
vices. 

Both  horizontal  and  vertical  wind  velocity  components 
were  generated  through  a  digital  simulation.  These  magni¬ 
tudes  were  assumed  constant  over  the  entire  airframe  with 
the  vnnd  restricted  to  occurrence  below  1  ,000-foot  altitude. 

In  essence,  the  simulation  provided  a  nornal  level  of  turbu¬ 
lence  with  some  degree  of  gusting  and  a  constant  directional 
bias.  Specifically,  the  turbulence  was  of  30  feet  per  second 
mean  and  5  feet  per  second  standard  deviation,  with  1  foot 
per  second  standard  deviation  in  the  vertical  plane,  end 
with  a  30  feet  per  second  constant  bias  at  -45",  this  with 

a  standard  deviation  of  2°. 

The  digital  simulation  program  sampled  the  digitized 

analog  inputs  from  the  RPV  flight  control  console  each  frame 
in  terms  of  control  stick  position,  thrust,  roll,  pitch,  and 
rudder  trims.  These  were  then  used  to  up-date  the  flight 
control  values  for  the  next  real-time  solution  of  the  equations 
of  motion.  Control  mode  data  input  prior  to  each  run  speci¬ 
fied  whether  the  attitude  control  stick  would  control  posi¬ 
tion  or  rate.  Discrete  signal  functions  were  also  provided 
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to  the  simulation  regarding  a  secondary  task  (suppression  of 
an  audio  tone),  expansion  of  the  altimeter  scale  by  a  factor 
of  ten,  and  tarqet  detection.  Certain  parameters  of  flight 
performance  were  recorded  on  the  EAI  8875  8-channel  strip 
chart  recorder.  Flqure  1  Indicates  the  information  flow 
throuqh  the  system. 

The  RP V  response  was  presented  to  the  pilot/subject 
by  means  of  an  attitude  display  qenerated  on  a  cathode  ray 
tube.  This  could  be  made  to  operate  in  either  inside-out  or 
outside  •in  node.  The  intended  course,  airspeed,  and  alti- 
t'  de  were  shown  on  a  plottinq  board  with  the  actual  pround 
track  plotted  in  real  time  as  the  experiment  proceeded. 

Additional  pointer-on-scale  instruments  provided  air¬ 
speed,  altitude,  heading,  and  range  with  respect  to  the 
target.  Indicator  lights  above  the  altitude  and  range  dis¬ 
plays  designated  their  operational  status.  The  target  it¬ 
self  only  appeared  on  the  CRT  when  ;he  aircraft  was  within 
suitable  range.  It  first  appeared  as  a  dot  on  the  horizon, 
then  qrew  with  the  approach  to  more  clearly  define  a  250  feet 
diameter  circle  inscribed  around  the  ground  tarqet.  The  sub¬ 
ject  was  instructed  that  this  tarqet  was  50  feet  high. 

The  constant  effects  of  enemy  video  FCM  took  the  form  of 
"snow"  superimposed  on  the  OPT  disnla.v  "video  signal." 

Various  controls  were  offered  on  the  console,  includinq 
push  buttons  to  allow  the  subject  to  change  the  altitude  scale 
and  indicate  his  having  detected  the  tarqet.  A  small  two-axis 
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control  stick  with  appropriate  trim  controls  allowed  him  to 
du.de  the  vehicle.  This  control  stick  coold  be  made  to  oper¬ 
ate  in  either  the  position  or  rate  modes.  Fi,Ure  2  shows  the 
experimental  set-up. 

Two  different  scenarios  of  comparable  difficulty  were 
used,  the  ftP V  beino  initially  acooired  over  friendly  terri¬ 
tory  at  an  altitude  of  2000  feet  some  thirteen  to  fifteen 
"Hes  from  the  target.  The  subject  was  then  required  to  re¬ 
duce  its  altitude.  In  so  doinq  he  encountered  increasin, 
atmospheric  turbulence.  His  task  was  to  follow  the  intended 
course  over  enemy  territory  (in  spite  of  the  jammine),  to 
approach  the  tarqet  at  an  altitude  between  300  and  500  'eet, 
and  to  dive  into  the  center  of  the  tarqet.  The  subject  was ’also 
presented  with  a  secondary  task  which  required  him  to  depress 
a  pedal  whenever  ,  tone  was  heard.  This  action  switched  of, 
the  randomly  actuated  audio  siqnal.  The  total  on-time  of 
this  siqnal  was  taken  as  in  inverse  measure  of  the  pilot's 
ability  to  perform  additional  tasks  beyond  that  required  for 
the  mission.  Various  measures  of  performance  were  taken  in- 
cludinq  cross-track  error,  altitude  error,  airspeed  error, 
time  required  for  tarqet  detection,  probability  of  target ’.c- 
quisition  computed  as  a  function  of  time,  handling  quality  of 
the  vehicle,  angle  of  impact,  and  miss  distance. 

Five  distinct  classes  of  subjects  were  called  upon.  The 
first  group  of  eight  Included  only  naive  subjects,  that  is. 
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individuals  holding  automobile  driving  experience  but  no 
knowledge  or  experience  In  aircraft  flight  control.  The 
second  group  of  eight  included  engineer  non-pi  lots. . .indi¬ 
viduals  familiar  with  flight  control  principles  but  having 
no  personal  experience  in  this  art.  The  third  group  of 
eight  in*’ tided  model  aircraft  pilots  who  had  achieved  signi¬ 
ficant  status  In  this  regard.  The  fourth  group  were  volun¬ 
teer  Navy  fighter  pilots  from  Miramar  Naval  Air  Station. 

The  last  group  of  eight  were  volunteer  Navy  attack  p1>ots 
from  Lenoore  Naval  Air  Station. 

Each  subject  filled  out  a  Questionnaire  concerning 
his  background  and  experience,  was  given  the  Witkin  Embedde i 
Figures  Test  and  received  an  Identical  briefing  before  par-, 
tlclpatlng  In  the  experiment.  Those  unfamiliar  with  flight 
control  were  shown  a  film  of  low  altitude  flight  to  give  them 
a  perspective  on  the  real  task.  After  completlno  the  simulated 
mission  they  were  debriefed  and  asked  to  write  a  commentary  on 
the  experiment  and  their  subjective  response. 

The  experimental  design  was  a3x2x2x2  factorial 
model.  The  Independent  variables  were  subject  groups  (Navy 
Attack  Pilots,  Model  Aircraft  Pilots,  and  Engineer  Non-Pilots);* 
control  stick  (rate  vs.  positional);  attitude  display  (Inside- 
out  vs.  outside-in);  and  attitude  prediction  (real-time  or 
prediction).  Preliminary  measurement  reveal  that  a  predic¬ 
tion  time  Interval  of  3.7  seconds  for  pitch  and  0.7  seconds 

♦the  other  two  groups  were  scored  but  not  used  In  this  analysis. 
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for  roll  served  to  minimize  mid-course  attitude  control 
errors  under  the  Imposed  level  of  turbulence.  Linear  extra¬ 
polation  of  these  times  Into  the  future  generated  the  predic¬ 
tive  attitude  mode  of  display.  Details  of  the  experimental 
desiqn  and  nethodoloqy  can  be  found  In  Appendix  A. 

Resul ts : 

Statistical  analysis  of  the  measures  taken  revealed  no 
significant  difference  In  performance  under  the  two  differ¬ 
ent  modes  of  attitude  display.  Surprlslnqly,  all  Navy  pilots 
preferred  the  outside-in  mode  of  attitude  display. 

Although  the  predictive  attitude  display  was  expected 
to  benefit  performance  this  was  not  the  case.  In  general, 
the  subjects  found  qreater  difficulty  when  using  this  mode. 
Under  prediction,  the  attitude  was  apparently  more  affected 
by  the  turbulence  and  thus  more  difficult  to  control.  Note 
that  this  predictive  display  was  neither  compensatory  nor 
pursuit  In  that  information  concerning  the  present  attitude 
of  the  aircraft  was  not  provided  to  the  subject  In  any 
manner.  The  adequacy  of  the  performance  without  predictive 
attitude  display  justified  eliminating  further  exploration 
In  this  regard.  Some  subjects  indicated  that  predictive 
heading  and  ranqe  displays  might  be  of  value. 

The  position  control  stick  was  found  to  be  superior  to 
the  rate  control  stick  for  all  subjects  In  terms  of  average 
cross-track  error  and  target  miss  distance.  Although  the 
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rate  stick  was  conventional,  all  subjects  preferred  the 
position  stick.  In  fact,  they  denonstrated  better  perfor¬ 
mance  with  the  position  control  stick  in  terms  of  the  crucial 
tarqet  approach  maneuver.  Obviously,  the  Navy  pilots  benefited 
least  from  the  position  stick,  because  of  their  qreater  fliqht 
ex,  jrience.  Evidently,  the  simpler  relationship  between  this 
control  and  the  aircraft  attitude  is  of  benefit.  Most  siq- 
ni ficantly ,  the  position  control  stick  qave  the  subject  sen¬ 
sory  attitude  feedback  thus  obviatinq  the  need  for  visual  con¬ 
tact  with  the  attitude  display.  This  was  particularly  bene¬ 
ficial  under  ECM  conditions. 

In  qeneral ,  Navy  pilots  proved  superior  in  terms  of 
their  ability  to  fly  safely  at  low  altitudes  and  in  terms  of 
tarqet  miss-distance.  No  significant  difference  was  noted 
between  groups  in  terms  of  cross-track  error.  No  signifi¬ 
cant  performance  difference  was  found  with  respect  to  enroute 
flioht  control  measures  between  the  subject  qroups,  but  signi¬ 
ficant  differences  uid  exist  in  terms  of  the  crucial  maneuver 
(v/hich  was  found  difficult  for  all  subjects  reqardless  of 
group).  Quality  of  performance  of  the  qroups  in  this  reqard 
was  found  to  be  in  the  order  expected;  that  is,  as  a  function 
of  kind  and  amount  of  experience. 

Analysis  of  scores  revealed  that  the  l/itkins  Embedded 
Figures  Test  offered  greatest  significance  as  a  predictor 
of  subject  performance .  Second  to  this  measure  was  the 
experience  of  the  subject  in  controlling  model  aircraft. 


Other  factors  contributed  far  less  to  any  ability  to  iden¬ 
tify  subjects  v/ ho  are  likely  to  perform  v/ell  in  such  a 
simulation.  Considerable  learning  was  observed  in  subjects 
having  little  military  flight  experience.  The  learning 
curves  show  that  an  order  of  magnitude  improvement  can  be 
achieved  in  the  first  two  hours  of  simulator  experience. 

Concl us i on : 

The  preliminary  conclusion  on  the  basis  of  this  experi¬ 
ment  concerned  the  mode  of  control  stick  operation.  The 
position  stick  was  found  to  be  superior  in  terms  of  perfor¬ 
mance  of  the  strike  mission.  The  use  of  a  predictive  atti¬ 
tude  display  without  reference  to  present  attitude  was  not 
found  to  be  useful  and,  in  fact,  often  degraded  performance, 
tio  significant  determination  could  be  made  with  respect  to  the 
inside-out  versus  outside-in  heads-up  attitude  display.  Further 
refinement  within  a  more  realistic  simulation  was  called  for 
in  this  regard.  Detailed  examination  of  the  findings  formed 
the  basis  for  devising  further  experiments  which  were  planned 
in  terms  of  weapon,  mission  simulation,  and  prospective  data 
analysis. 

Summary  of  Independent  variables: 

Attitude  display:  Inside-out  vs.  outside-in 

Attltuae  prediction:  present  attitude  vs.  future  attitude 

Control  node:  rate  stick  vs.  position  stick 

Subject  groups:  naive  vs.  engineers  vs.  Naval  pilots 
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INTRODUCTION  TO  FURTHER  EXPERIMENTS 

The  findings  of  the  first  experiment  emphasized  the 
need  for  more  realistic  simulation.  A  movinq  map  drive 
mechanism  was  devised  and  placed  before  a  television  camera 
mounted  to  view  the  map  from  a  movinq  platform  with  variable 
orientation  with  respect  to  the  map  (as  shown  in  Flqure  3), 
all  this  beinq  driven  in  accordance  with  the  response  of  the 
fliqht  of  the  aircraft  durlnq  the  simulated  mission.  A  new 
computer  proqram  was  written  to  represent  the  dynamics  of 
the  FDL-23  aircraft.  This  proqram  was  suitably  coupled  to 
the  above-referenced  mechanism. 

A  cockpit  was  configured  with  console  including  conven¬ 
tional  flight  instruments  as  might  be  required  in  support  of 
the  proposed  mission.  A  21-inch  CRT  offered  the  heads-up 
video  display  and  appropriate  symbology.  Specifically,  the 
conventional  instruments  included  a  two-axis  attitude  direc¬ 
tion  indicator  (ADI),  a  horizontal  situation  indicator  (HSI), 
an  airspeed  .ndicator,  an  altimeter,  a  ra te -of -c 1 i mb  indicator, 
a  sideslip  angle  indicator,  a  q-meter,  control  surface  position 
indicator,  and  a  clock.  Means  were  also  provided  for  coverinq 
certain  of  these  instruments  as  required  by  the  experimental 
procedure.  See  Appendices  B  and  C  for  further  details. 

The  controls  offered  to  the  pilot/subject  included  a 
center  stick  for  flight  control,  rudder  pedals,  pitch  and  roll 
trim  controls,  and  a  side-stick  camera  control  mounted  for 
left-handed  actuation  which  directs  the  sensor  in  pitch 
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and  yaw.  A  trim  switch  on  top  of  the  camera  control  was 
provided  for  zoom.  Push  buttons  and  a  trinqer  on  the  center 
stick  were  used  for  indication  of  tarqet  recoanition  and 
for  weapon  release.  Fiqure  4  shows  a  portion  of  this 
cockpit  with  the  sensor  lookinq  directly  down  at  a  point  on 
the  qround. 

The  first  of  these  more  realistic  simulation  experiments 
was  intended  to  investinate  the  potential  conflict  between 
the  attitude  displays  and  sensor  mountinq  modes.  Indeed, 
this  experiment  qenerated  further  questions  in  this  reqard 
and  thus  led  to  Experiment  III.  The  result  of  Experiments 
II  and  III  were  used  in  the  desiqn  of  Experiment  IV  which 
investiqated  display  and  control  problems  associated  with 
the  crucial  phase  of  the  strike  mission.  All  subjects  in  the 
followinq  experiments  were  volunteer  Navy  fiohter  pilots 
from  Miramar  Naval  Air  Station.  In  each  case  they  were 
briefed  as  to  the  intent  of  the  experiment,  completed  ques¬ 
tionnaires  similar  to  those  used  for  the  first  experiment, 
were  debriefed  and  asked  to  write  a  commentary  on  their 
experience  in  the  simulation. 


EXPERIMENT  FI 


Problem  Statement 

The  literature  review  and  findinos  of  Experiment  I  led 
to  nev/  questions  concerning  display  modes.  Specifically, 
does  the  sensor  mounting  affect  the  pilot's  ability  to  con¬ 
trol  the  ft P V ?  Is  there  truly  a  difference  between  the  pilot's 
performance  with  inside-out  and  outside-in  heads-un  attitude 
display?  Is  ttiere  a  difference  between  the  performance  us¬ 
ing  these  heads-up  display  modes  and  the  conventional  ADI? 
Finally,  does  the  mode  of  sensor  mounting  affect  Performance 
under  various  nodes  of  heads-up  attitude  display? 

Experimental  Design: 

General  Procedure 

The  scenario  for  this  experiment  required  the  pilot/ 
subject  to  acquire  the  RPV,  fly  it  to  a  specific  altitude 
(either  5,000,  5,500,  0,500  or  7,000  feet),  and  brinq  the 
vehicle  to  straight  and  level  flight  using  the  displays 
available  in  that  portion  of  the  procedure.  At  an  appro¬ 
priate  time  (unknown  to  the  pilot)  the  attitude  of  the  air¬ 
craft  was  disturbed  by  a  hard  over  surface  command  of 
variable  duration.  The  subject  had  been  previously  in¬ 
structed  to  maintain  level  flight  especially  if  severe 
disturbances  were  encountered.  His  ability  to  hold  al¬ 
titude  during  this  level  flight  attitude  control  portion 
of  the  simulated  mission  was  not  measured. 
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The  RPV  was  acauired  at  an  altitude  of  6,000  feet  at  450 
knots  airspeed.  The  pilot  was  not  evaluated  on  his  ability  to 
maintain  any  particular  speed.  Throttle  control  was  not  used 
durino  these  runs.  After  attaining  level  flight  at  the 
desired  altitude  the  hard  over  surface  command  was  introduced. 
Recovery  from  this  deviation  automatically  terminated  the 
run.  These  runs  varied  in  duration  from  ten  to  sixty  seconds. 

The  test  conductor  Initiated  each  run  from  a  remote* 
hand  held  console  and  was  in  continuous  visual  and  verbal 
contact  with  the  subject.  Before  each  run  the  subject  was 
instructed  as  to  the  display  and  control  configuration  he 
would  experience.  The  test  conductor  introduced  the  problem 
after  noting  that  the  situation  was  appropriate.  He  exer¬ 
cised  the  option  of  terminating  the  run  before  its  normal 
completion  If  flight  control  was  lost  or  recovery  could  not 
be  regained  within  an  acceptable  time  span.  The  display  and 
control  configuration  and  computer  operation  required  for 
simulation  coulu  be  controlled  from  the  test  conductor's 
console.  Upon  completion  of  the  data  transcription  resulting 
from  each  run,  the  test  conductor  would  alter  the  display  con 
figuration  In  accordance  with  the  experimental  procedure  and 

prepare  the  subject  for  the  next  run. 

tach  subject  was  Instructed  to  perform  a  secondary  foot¬ 
tapping  task,  thus  indicating  his  level  of  stress  and  residual 


channel  capacity.  Difficulties  encountered  in  interpreting 
this  secondary  task  caused  it  to  be  abandoned  after  the  first 
series  of  experiments. 

Tl.c  experimental  procedure  was  devised  to  control  the 
display  and  control  configuration  available  in  each  run  over 
a  variety  of  flight  conditions  as  night  he  encountered  in 
the  strike  mission.  The  available  information  to  the  pilot/ 
subject  and  his  control  authority  was  successively  restricted 
while  his  task  remained  to  maintain  flight  control  through 
induced  attitude  anomaly.  To  repeat,  the  purpose  of  this 
experiment  was  to  measure  the  subiect's  ability  to  cope  with 
ambiguous  and  incompatible  display  formats  in  his  execution 
Of  simple  RPV  flight  control. 

The  first  intent  was  to  identify  problems  which  mioht  arise 
in  a  situation  wherein  the  RPV  pilot  views  conflicting  dis¬ 
play  formats  (that  Is,  wherein  outside-in  and  inside-out 
displays  are  used  concurrently).  The  second  objective  was 
to  order  the  display  combinations  in  terns  of  their  support 
for  the  basic  requirement  of  attitude  control  of  the  RPV. 

Seven  different  measures  of  performance  were  taken  on 
this  task,  the  subjects  being  scored  on  four  continuous 
variables:  aircraft  movement  as  a  function  of  pitch  and 
roll,  time  required  for  recovery  to  level  flight,  response 
tine  of  the  subject,  time  to  the  first  correct  movement  of 
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the  control,  and  three  discrete  neasures  pertinent  to  con¬ 
trol  reversals:  the  number  of  reversals  in  roll,  in  pitch, 
and  the  total  number.  See  Appendix  D  for  details  of  per¬ 
formance  measurement.  See  Appendix  E  for  details  on  the 
subjects  and  Appendix  F  for  details  on  the  experimental  de- 
siqn,  methodoloqy  and  data  reduction. 

This  experiment  was  conducted  in  three  separate  phases. 
These  phases  involved  the  same  basic  performance  scores, 
tasks,  scenarios,  and  equipment.  The  difference  in  the 
phases  was  the  independent  variables  under  study.  The  var¬ 
ious  phases,  the  independent  variables  for  each  phase,  and 
the  reasons  for  the  different  phases  were  as  follows: 

Phase  One 

In  Phase  One  the  independent  variables  consisted  of  three 
levels  of  sensor  mounting  mode  (fixed  to  airframe,  smoothed 
to  eliminate  jitter,  stabilized  to  eliminate  all  aircraft 
attitude  movement);  and  four  levels  of  attitude  presentation 
mode  (ADI  only,  video  aircraft  symbol  only,  both  ADI  and 
this  aircraft  symbol,  no  attitude  display).  The  fixed  con¬ 
ditions  were  the  sensor  downlool;  angle  (15°)  and  the  lenqth 
of  time  the  aircraft  was  exposed  to  the  attitude  perturba¬ 
tion  (20-computer  cycles,  or  approximately  one  second).  Two 
subjects  were  utilized  in  this  phase. 

Phase  Two 

Two  considerations  were  involved  in  the  evolution  of 
Phase  Two.  The  most  important  was  the  discovery  that  the 
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aircraft  symbol  attitude  display  used  in  Phase  One  was  in¬ 
advertently  responding  as  an  inside-out  display  instead  of 
as  an  outside-in  display.  This  was  a  pluq-board  error  but 
the  resulting  data  was  not  discarded  and  was  analyzed  be¬ 
cause  of  its  potential  value  in  studying  inside-out  versus 
outside-in  behavior.  The  second  consideration  in  develon- 
ment  of  Phase  Two  was  the  sensor  downlook  angle  of  lb°.  It 
was  apparent  that  this  downlook  angle  with  the  30'  wide  by 
24°  high  sensor  field  of  view  did  not  allow  the  pilot  much 
useful  attitude  feedback  from  the  video  (that  is,  the  horizon 
line  was  not  visible  under  level  flight  and  pitch  down  con¬ 
ditions).  This  was  particularly  noticeable  when  the  pilot 
had  no  other  available  attitude  information  (that  is,  no  ADI 
and  no  video  aircraft  symbol).  This  led  to  a  lack  of  con¬ 
trollability  of  the  RPV  and  failure  to  complete  the  prescribed 

task . 

To  correct  for  this  situation  Phase  Two  differed  from 
Phase  One  in  tnat  the  aircraft  symbol  now  resoonded  as  intended 
and  the  sensor  downlook  angle  was  reduced  to  7.5°.  In 
Phase  Two  the  perturbation  length  was  also  controlled  as  an 
independent  variable.  Two  levels  of  perturbation  time  were 
used.  One  level  was  1  sec  as  used  in  Phase  One  and  the  other 
level  was  of  shorter  time  (approximately  180  milliseconds). 

The  shorter  time  was  introduced  because  the  subjects  were  re¬ 
sponding  before  the  perturbation  was  completed. 
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Phase  Three 


Phase  Three  was  developed  as  a  result  of  the  subjects 
behavior  in  Phases  One  and  Two.  Specifically,  they  demon¬ 
strated  persistent  use  of  the  ADI  when  it  was  available. 

This  resulted  in  disregarding  the  video  as  a  reference.  This 
behavior  might  have  been  in  response  to  a  conflict  between 
the  outside-in  video  and  the  inside-out  ADI  display.  Note 
that  the  pilots  are  very  familiar  with  the  ADI,  both  from 
their  training  and  experience. 

In  Phases  One  and  Two  it  was  discovered  that  Dilots  could 
not,  or  at  least  found  it  very  difficult  to,  perform  the 
task  when  they  had  no  attitude  displays,  that  is,  fly  with 
only  the  video,  altimeter,  and  rate  of  climb  indicator.  It 
was  expected  that  there  would  be  difficulty  with  this  con¬ 
figuration  especially  v/ith  a  stabilized  sensor,  but  not  to 
the  degree  observed.  It  was  oenerally  found  that  the  sub¬ 
jects  could  complete  the  task  with  the  fixed  sensor  mounting 
mode,  although  the  performance  was  significantly  degraded. 
Control  was  virtually  impossible  with  the  smoothed  and 
stabilized  sensor  mounting  modes  under  these  conditions. 
Further  testing  v/ith  no  attitude  display  was  therefore 
dropped . 

It  then  appeared  appropriate  to  refine  the  study  by  look¬ 
ing  at  inside-out  versus  outside-in  with  attitude  displays 
and  sensor  mounting  modes.  Phase  Three  consisted  of  the 
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following  independent  variables: 

1)  sensor  mounting  node  (fixed  or  stabilized),  and 
l)  attitude  display  mode  (video  aircraft  symbol  or 
video  artificial  horizon  line), 
i he  four  possible  combinations  of  these  two  variables 
gave  the  four  possibilities  of  an  inside-out  or  outside- 
in  sensor  mounting  node  (fixed  or  stabilized)  versus  an 
inside-out  or  outside-ir  attitude  display  (artificial 
horizon  or  aircraft  symbol). 

The  subjects  were  instructed  to  use  the  ADI,  which  was 
always  uncovered,  but  were  cautioned  that  it  may  malfunc¬ 
tion  (which  was  deliberately  the  case  when  the  perturbation 
was  Introduced).  Because  the  ADI  was  "unreliable"  the  sub¬ 
jects  depended  upon  the  heads-up  conf i ourati on*for  attitude 
information.  The  perturbation  time  was  held  constant  (180 
milliseconds)  and  the  task  completion  tolerances  were  relaxed 
so  that  the  subject  was  required  to  maintain  the  vector  sum 
of  pitch  and  roll  within  three  degrees  of  zero  for  three 

seconds.  (Analysts  revealed  the  prior  requirement  of  two 
deqrees  for  three  seconds  tolerance  was  excessively  strinqent.) 
results 

Phase  One: 

Response  tines  were  nenerally  shorter  when  backoround 
viheo  notion  cues  were  available,  that  is.  with  fixed  sensor 


refer‘to  dils?lays°on ^haYwo^be  the"  '.'h*ads-uP"  is  taken  to 
were  onboard  the  vehicle.  d  b  th  windscreen  if  the  pilot 
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mounting  mode.  Completion  times  were  longer  end  the  amount 

of  aircraft  movement  was  noted  to  be  greater  when  the  video 

aircraft  symbol  responded  as  an  Inslne-out  display  compared 

to  the  video  artificial  horizon  and  ADI.  Use  of  an  aircraft 

symbol  video  attitude  display  Increased  the  number  of  control 
reversals. 

Phase  Two: 

The  time  expended  prior  to  Initiating  correct  movement 
In  response  to  the  perturbation  was  shorter  with  the  ADI  as 
compared  to  the  video  aircraft  symbol.  Recovery  times  were 
longer  and  the  aircraft  movement  greater  with  use  of  the 
video  aircraft  symbol.  These  conditions  were  true  for  both 
perturbation  duration  times.  Less  aircraft  movement  was 
observed  when  the  video  Information  more  nearly  resembled 
the  normal  Inside-out  motion-cue  condition,  m  this  phase 
the  video  aircraft  symbol  was  observed  to  contribute  to  the 
number  of  overall  control  reversals  and.  In  particular,  to 
the  roll  reversals. 

Phase  Three: 

It  was  noted  that  the  time  to  respond  to  the  perturbation 
decreased  when  the  video  attitude  display  and  sensor  mount¬ 
ing  were  In  the  same  modes.  The  artificial  horizon  was 
responsible  for  better  performance  In  terns  of  time  to 
Initiate  correct  movement,  however,  this  display  contri¬ 
buted  to  Increased  pitch  reversals.  It  was  again  observed 
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that  the  video  aircraft  symbol  display  contributed  to  the 
number  of  roll  reversals.  Greater  experience  with  the 
video  aircraft  symbol  did  not  improve  the  subjects  perform¬ 
ance  in  terms  of  reversals.  Perhaps  some  minimum  percentane 
of  control  reversals  is  an  intrinsic  character  of  human  ner- 
for*  ance.  More  detailed  discussion  of  these  results  can  be 
found  in  Appendix  G. 

CONCLUSIONS 

Observations  across  the  three  experimental  nhases  revealed 
that  the  AOI  contributed  to  superior  performance  when  com¬ 
pared  with  the  other  two  attitude  displays.  The  AOI  and 
video  artificial  horizon  displays  both  contributed  to  shorter 
times  to  initiate  correct  control  movement.  And  yet  these 
displays  were  responsible  for  more  control  reversals  in  pitch 
attitude  as  compared  to  the  aircraft  symbol. 

It  was  observed  that  overall  performance  with  respect  to 
response  tines  was  generally  improved  with  normal  motion 
cues  (fixed  sensor  node)  as  the  video  background  information, 
tendency  was  also  observed  toward  improved  efficiency  in 
terms  of  less  aircraft  movement  in  this  mode.  Response  tines 
also  decreased  when  video  attitude  di sp  i  ay/sensor  mounting 
nodes  were  compatible. 

In  general,  the  video  aircraft  symbol  was  a  less  desir¬ 
able  display.  It  contributed  to  significantly  longer 
recovery  completion  times,  greater  aircraft  movement,  a 


larger  number  of  control  reversals  and,  particularly,  more 
reversals  in  roll.  Completion  times  and  aircraft  movement 
measures  were  also  adversely  affected  when  the  video  air¬ 
craft  symbol  responded  as  an  artificial  horizon.  These 
factors  may  be  attributable  to  both  the  direction  of  the 
video  symbol  movement  and  some  intrinsic  characteristic  of 
the  symbol  format.  As  stated  earlier,  experience  in  usino 
the  video  outside-in  aircraft  symbol  did  not  reduce  the  num¬ 
ber  of  control  reversals. 

It  was  observed  that  a  large,  sudden  perturbation  of 
short  duration  affecting  aircraft  attit.de  contributed  to 
a  more  serious  control  problem,  that  is,  longer  recovery 
times  and  greater  aircraft  movement.  Therefore,  such  a 
perturbation  was  required  to  produce  subject  responses  re¬ 
sulting  in  more  sensitive  measures  of  display  suitability. 

Analysis  of  the  Embedded  Fiqures  Test  scores  with  per¬ 
formance  scores  on  control  tasks  revealed  definite  tenden¬ 
cies  toward  significant  positive  correlations.  (See  Appendix 
L)  Thus,  even  with  a  relatively  homogenous  group,  such  as 
these  pilot/subjects,  differentiation  in  performance  mea¬ 
sures  were  predictable  from  the  use  of  a  relatively  simple  test. 
Summary  of  Independent  Variables 

Phase  One 

Attit”vje  display  mode  (3  levels) 

Inside-out  aircraft  symbol  video  attitude  display 

ADI  attitude  display 

Inside-out  aircraft  symbol  video  and  ADI  attitude  display 


Sensor  nountinq  node  (3  levels) 

Fixed 

Snoothed 

Stabilized 

Phase  Two  -  Independent  Variables 
Attitude  display  node  (3  levels) 

Outside-in  aircraft  synbol  video  attitude  display 
ADI  atti tude  display 

Outside-in  aircraft  symbol  video  and  ADI  attitude  display 
Sensor  mounting  mode  (3  levels). 

F  i  xed 

Smoothed 

Stabilized 

Perturbation  tine  (2  levels) 

One  second  duration 
100  milliseconds  duration 
Phase  Three  -  Indepen dent  Variables 
Attitude  display  node  (2  levels) 

Inside-out  attitude  display  (artifical  horizon) 

Outside-in  video  attitude  display  (aircraft  symbol ) 

Sensor  nountinq  node  (2  levels) 

Fixed  (inside-out) 

Stabilized  (outside-in) 


30 


EXPERIMENT  III 


Problem  Statenent 

The  third  experiment  was  conducted  to  explore  a  combina¬ 
tion  heads-up  attitude  display  and  investiqate  pilot  per¬ 
formance  under  more  stringent  conditions,  this  on  the  basis 
of  Experiment  II,  Phase  3.  In  that  study,  two  video  attitude 
displays  (aircraft  symbol  and  artificial  horizon)  and  two 
sensor  mounting  modes  (fixed  and  stabilized)  were  contrasted 
under  simulated  flight  conditions.  The  particular  outcome  of 
interest  was  that  the  aircraft  symbol  (an  outside-in  display) 
reduced  the  number  of  pitch  reversals  and  the  artificial 
horizon  (an  inside-out  display)  reduced  the  number  of  roll 
reversal s  . 

Hazards  identified  with  low  altitude  PPV  missions  include 
disorientation  as  a  result  of  navigation  difficulties  and 
premature  termination  as  a  result  of  control  error.  Rapid 
decision-making  is  mandatory.  Effective  flight  control  under 
these  conditions  requires  positive  control  handling  and  quick 
aerodynamic  response,  particularly  as  compared  to  hinher  altitude 
flight  as  previously  studied.  Could  a  display  he  conceived 
which  would  maximize  the  beneficial  features  of  each  of  the 
two  contrasting  attitude  displays?  Although  the  display-pro¬ 
ducing  equipment  available  for  this  study  was  somewhat  limited 
in  terms  of  graphics,  a  composite  display  was  generated. 
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This  display  consisted  of  an  aircraft  symbol  depictinn 
°nl u  pitch  and  an  artificial  horizon  s  vnbo 1  onlv  used  for 
roll.  Finure  5  depicts  this  display  alonn  with  the  other 
attitude  dlsplavs.  The  aircraft  symbol  simply  moved  up  or 
down  showlnn  Ditch  ascent  or  descent  respectively  (outside- 
in  mode).  The  artificial  horizon  responded  to  only  roll, 
dlsplaylnn  this  in  an  inside-out  format.  The  aircraft  sym¬ 
bol  was  also  made  more  realistic  (with  lonoer  wines  and 
shorter  tall)  than  the  previously  used  symbol.  This  chanoe 
was  accomplished  to  allow  nreater  opportunity  for  the  sub¬ 
jects  to  recoqni ze  aircraft  motion  b.v  mal'inn  the  smaller 
symbol  movements  more  obvious  and  appropriate. 

The  problem  was  to  compare  this  new  display  with  the  pre¬ 
vious  displays  in  order  to  discover  a  further  principle  of 
display  and  control . 

Experimental  Design 

Experiment  III  was  concerned  with  comparing  the  combina¬ 
tion  video  attitude  display  with  the  other  attitude  displays 
under  conditions  of  low-altitude  flight.  Two  independent 
variables  were  considered.  The  first  was  the  video  attitude 
display,  consisting  of  three  levels:  aircraft  symbol,  artifi¬ 
cial  horizon,  and  the  combination.  The  second  variable  was 
the  sensor  mounting  mode  consisting  of  two  levels:  fixed  and 
stabilized.  Further  details  on  exnerimental  design,  subjects, 
performance  measurement,  and  data  reduction  may  be  found  in 
Appendices  D,  t,  and  tl . 
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F  i  g  u  r  e  b  A 

Video  Aire  re  f  t  Symbol  Attitude  Display 


Figure  S  ['. 

Video  Artificial  Horizon  Attitude  Display 


Figure  bC 

Video  Con!)  i  na  t  i  on  Attitude  Display 
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Results 

The  results  of  experiment  III  revealed  that  the  corbina- 
tion  video  attitude  display  decreased  the  number  of  control 
reversals  as  compared  to  the  other  two  attitude  displays.  A 
significant  increase  in  the  number  of  roll  reversals  was 
noted  with  use  of  the  aircraft  symbol.  This  symbol  contri¬ 
buted  to  significantly  shorter  response  tine. 

The  artificial  horizon  was  significantly  less  efficient 
for  aircraft  flight  control  (that  is,  there  was  more  aircraft 
movement).  In  this  experiment,  the  subjects  demonstrated 
significant  learning  with  respect  to  aircraft  flight  control. 
Details  of  results  are  found  ’n  Appendix  I. 

Concl usi  on 

It  was  shown  that  the  combination  display  promises  im¬ 
provement  in  terns  of  minimization  of  control  reversals  when 
compared  to  other  displays.  For  fixed  sensor  mounting,  the 
aircraft  symbol  showed  s  i  an i f i cant  1 y  improved  performance. 
Learning  to  control  an  RPV  under  difficult  conditions  was 
amply  demonstrated  within  this  experiment.  If  the  stabilized 
sensor  mounting  mode  is  required  (for  example,  as  in  target 
detection),  the  aircraft  symbol  should  be  used  to  display 
attitude.  In  all  other  cases  the  combination  disolay  should 
be  used. 

Summary  of  independent  variables: 

Attitude  display:  artificial  horizon  (inside-out)  vs. 

combination  disnlav  vs.  aircraft  symbol  (outside-in) 
Camera  mountino:  fixed  to  airframe  (inside-out)  vs. 
stabilized  (outside-in). 
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EXPERIMENT  IV 


Problem  Sta tement 

The  purpose  of  this  experiment  was  two-fold.  First, 
to  ascertain  the  ability  of  experienced  Navy  pilots  in 
flying"  a  realistic  RPV  strike  mission.  Second,  to  Identify 
realistic  display  and  control  options  for  the  RPV  strike 
missions  and  to  compare  these,  once  determined. 

Several  different  controls  and  displays  are  available 
for  a  potential  strike  RPV.  These  can  replace  the  familiar 
(to  experienced  pilots)  in-flight  feedback  and  enhance  per¬ 
formance.  There  is  the  potential  of  sensor  slewing  to  replace 
the  in-flight  requirement  for  head  turninq  for  target  search, 
navigation,  orientation,  and  so  forth.  There  is  the  possi¬ 
bility  of  sensor  zooming  to  replace  the  lack  of  "depth  per¬ 
ception"  to  enhance  target  search  and  attack  performance. 

There  are  alternate  possibilities  of  sensor  mounting.  One 
is  to  have  the  sensor  fixed  to  the  RPV  airframe,  thus  giving 
picture  feedback  similar  to  that  experienced  from  inside 
the  aircraft.  Another  alternative  is  to  stabilize  the  sensor 
with  respect  to  aircraft  pitch  and  roll.  This  would  provide 
picture  feedback  more  similar  to  the  RPV  pilot's  actual 
situation,  that  is,  from  outside  the  aircraft.  Previous 
experiments  have  determined  compatible  heads-up  attitude 
displays  for  these  two  sensor  mountings.  (See  Experiment  II, 
Phase  3  and  Experiment  III  for  these  results.) 
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The  scenario  designed  for  this  experiment  was  intended 
to  simulate  target  acquisition  and  attack.  The  subject  took 
control  of  the  aircraft  at  an  altitude  of  1,000  feet,  an  air- 
speed  of  325  knots,  heading  of  North,  at  approximately  six 
"iiles  due  south  of  the  target.  These  initial  factors  were 
chosen  to  simulate  the  RPV  haying  been  vectored  into  the  tar¬ 
get  area.  The  subject  was  instructed  to  "fly"  the  RPV  to  an 
altitude  of  500  feet  and  to  maintain  that  altitude  until  he 
was  2-1/2  miles  from  the  target  (approximately  25  seconds 
from  start  of  flight).  This  simulated  a  low-altitude  pene¬ 
tration  of  enemy  territory.  At  that  .point  he  was  near  sighting 
range  of  the  target  and  climbed  to  an  altitude  of  1,500  feet 
and  began  target  search.  This  action  simulates  the  beginning 
of  a  “pop-up"  maneuver.  Upon  sighting  the  target  the  subject 
was  to  depress  a  switch  indicating  target  recognition.  The 
subject  then  prepared  for  a  target  attack  by  placing  the 
reticle  on  the  target  while  diving  onto  the  target.  At  an 
altitude  of  700  to  500  feet  and  with  the  target  in  the  reticle 
the  subject  activated  weapon  release.  After  weapon  release 
the  subject  was  to  regain  altitude.  At  this  time  the  scenario 
ended  presuming  the  RPV  to  be  returned  to  base  by  the  same 
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’.ethod  it  was  brought  to  the  target  area.  The  completed 
mission  took  from  60  to  100  seconds,  depending  on  the  subject's 
control  of  the  RPV. 

Lach  subject  performed  this  task  four  tines  for  each 
target/displ ay-control  configuration.  There  were  six  target 
selections,  one  for  each  of  the  six  display-control  confinura- 
tions  presented  to  the  subject.  The  required  mission  simu¬ 
lated  a  multi-RPV  attack  with  sequential  tarqet  strikes  being 
performed  by  the  same  pilot. 

This  experiment  investigated  the  relative  worth  of  various 
display  and  control  options  for  a  strike  mission.  The  dis¬ 
play  options  were  fixed  sensor  mounting  with  combination  video 
attitude  display  (see  Experiment  III)  and  stabilized  sensor 
mounting  with  an  aircraft  symbol  video  attitude  display.  The 
control  options  were  presence  or  absence  of  fixed  rate  zoom 
control  and  presence  or  absence  of  positional  sensor  slewing 
control.  Two  types  of  target. nq  tasks  were  also  investigated. 
One  task  used  a  simulated  "dumb"  weapon  (one  that  follows  the 
aircraft  trajectory  upon  release).  The  second  task  used  a 
simulated  "smart"  weapon  (one  that  homed  on  a  target  desig¬ 
nated  by  the  sensor  orientation  at  release).  After  release 
the  "smart"  weapon  is  assumed  to  impact  on  the  ground  where 
the  sensor  was  pointing  at  the  time  of  release.  Note  that 
without  slewing  these  tasks  are  essentially  identical,  so 
that  three  different  slewing/weapon  configurations  were 
used  instead  of  four. 
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Performance  for  Experiment  IV  was  measured  over  the 
three  stages  of  the  scenario.  Stage  one  performance  (low 
altitude  flight)  was  measured  by  calculating  the  altitude, 
airspeed,  and  heading  averages  and  standard  deviation  and 
thus  comparing  these  to  the  desired  values.  Stage  two 
(target  search)  performance  was  measured  by  the  target  recog¬ 
nition  time,  and  the  slant  range  to  the  target  at  this  time. 
The  third  stage  (target  attack)  performance  was  measured  by 
the  weapon  release  time,  weapon  release  slant  range,  weapon 

release  altitude,  and  down-range  and  cross-range  of  the  im¬ 
pact. 

Eight  pilots/subjects  from  Miramar  Naval  Air  Station 
were  utilized  in  this  experiment.  Four  of  these  subjects  used 
the  combination  attitude  display  of  fixed  camera  mode  and  four 
used  the  aircraft  symbol/stabilized  mode.  Each  subject  per¬ 
formed  four  repetitions  on  each  of  six  different  display- 
control  configurations  (two  zoom  options  and  three  weanon/ 
slewing  options).  The  configurations  were  presented  in  a 
2  x  3  balanced  order  for  each  of  the  two  attitude  display/ 
sensor  mode  options.  Further  details  of  subjects,  performance 
measurement,  experimental  design,  methodology,  and  data  re¬ 
duction  are  described  in  Appendices  b,  L,  and  J. 


Results 

tio  sinqle  independent  variable  resulted  in  sinnificant 
differences  on  the  performance  variables.  Further  analysis 
of  the  error  mean  square  ( EMS )  values  for  each  set  of  four 
repetitions  uncovered  several  interestinq  interactions.  The 
availability  of  zoom  control  increased  the  tarqet  recoonition 
slant  range  EMS  (i.e.,  resulted  in  less  consistent  slant 
ranqe  for  weapon  release).  There  was  sinnificant  interaction 
between  the  attitude  di sol  ay/camera  node  and  the  task  vari¬ 
ables.  This  interaction  was  with  respect  to  the  pnroute  vari 
able  of  altitude,  the  weapon  release  time,  and  miss  distance. 
In  all  these  cases  the  interaction  indicated  two  orderinns 
of  the  task  options  deoendinq  on  the  attitude  di spl a v/sensor 
mode  beinq  used.  With  the  combination/fixed  mode  the  order- 
inq  (from  low  to  hiqh  EMS)  was  no  slew/'dunh'  weapon,  slew/ 
'dumb'  weapon,  and  slew/'smart'  weapon.  With  the  aircraft 
symbol  /stabi  1  i  zed  mode  this  order  '-as  reversed.  There  were 
indications  of  similar  interaction  with  the  zoom  and  task 
variables.  With  zoom,  the  ordorinq  (anain  low  to  hinh  EMS) 
v/as  no  slew/'dumb'  weapon,  slew/'dumb'  weapon,  slew/'smart' 
weapon.  With  no  zoom  control  available  this  orderino  tended 
to  be  reversed.  Details  of  results  for  this  experiment  are 
found  in  Appendix  K. 


Cone! usl ons 

A  cautious  interpretation  of  the  results  from  this  experi¬ 
ment  was  required.  No  single  mode  or  control  proved  to  be 
significantly  better  overall.  The  results  did  show  that 
certain  control  and  display  combinations  were  conditionally 
better  than  others.  Specifically,  the  best  combination 
was  the  stabilized  sensor  mode  with  aircraft  symbol  attitude 
display,  slewing  with  a  "smart"  weapon,  and  no  zoom  control. 

If  the  stabilized  platform  or  the  "smart"  weapon  is  not 
available  then  the  sensor  should  be  fixed  with  the  combination 
attitude  display,  no  slewing  with  a  "dumb"  weapon,  and  zoom 
control  available. 

Summary  of  Independent  variables: 

attitude  display/camera  mode:  Aircraft  symbol /s tabl 1 i zed  vs. 

combination/fixed  to  airframe 
zoom:  no  zoom  vs.  zoom  capability 

slew/weapon  type:  no  slew/"dumb"  weapon  vs.  slew/"dumb" 

weapon  vs.  slew/"smart"  weapon. 
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MINI-RPV  SIMULATION  EXPERIMENT 

The  simulation  of  aircraft  dynamics  was  modified  so 
that  these  reflect  the  dynamics  of  a  typical  mlnl-RPV. 

One  of  the  pilots  who  served  in  the  preceding  experiment 
wes  requested  to  control  this  vehicle  through  the  perfor¬ 
mance  of  two  simulated  missions.  In  the  first  his  task 
was  a  strike  mission  similar  to  that  described  for  exper¬ 
iment  IV.  He  was  then  requested  to  perform  a  laser  desig¬ 
nation  mission  wherein  the  task  was  to  maintain  the  reti¬ 
cle  on  the  target  for  as  long  as  possible. 

A  cursory  examination  of  the  resulting  data  revealed 
that  the  mlnl-RPV  can  be  controlled  in  a  similar  manner 
to  the  full  scale  aircraft.  This  pilot/subject  could  per¬ 
form  the  tasks  as  well  or  even  better  with  the  mini-RPV. 

He  demonstrated  an  ability  to  maintain  attitude  control 
under  severe  gusting  conditions  even  with  a  rate  stick 
although  this  mode  of  attitude  control  reflected  poorer 
performance.  The  mission  assignments  were  successfully 
accomplished. 
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OVERALL  CONCLUSIONS 


After  preliminary  consideration  of  alternative  RPV  em¬ 
ployment,  attention  was  focused  on  the  strike  mission  with 
intended  recovery.  Experimental  evidence  was  then  oathered 
on  the  different  modes  of  attitude  display  and  control  for 
such  an  RPV.  The  positional  control  stick  was  found  to  be 
superior  to  the  rate  control  stick.  Mountinq  the  sensor 
fixed  to  the  airframe  was  superior  to  other  sensor  mountinq 
modes,  that  is,  stabilized  mountinq  with  respect  to  pitch 
and  roll  or  smoothed  mountinq.  Smoothino  in  the  sensor 
mountinq  provided  no  advantaqe  in  any  reqard.  Results  of 
this  initial  experiment  identified  several  attitude  display 
control  options  suitable  for  more  realistic  experiments.  Ad¬ 
ditional  options  were  found  worthy  of  investiqation. 

A  combin'**  ‘  on  attitude  display  (inside-out  for  roll 
presentation  -  outside-in  for  pitch)  was  found  to  be  su¬ 
perior  to  either  sinqle  mode  of  presentation  if  the  sensor 
is  fixed  to  the  airframe.  Note  that  this  is  not  what  woul 
have  been  expected  accordinq  to  the  conventional  dictum  of 
human  enqineerinq. 

Various  conclusions  can  be  drawn  from  these  experiments. 

If  a  fixed-to-the-alrframe  sensor  is  used,  the  artificially 
induced  sensor  movement  (termed  "slewino")  deorades  perfor¬ 
mance.  Slewinq  is  not  desirable  with  a  "dumb"  weapon  (one 
which  follows  the  vehicle  trajectory  from  the  point  of  launch). 
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Slewing  aids  performance  If  a  stabilized  platform  Is  avt li¬ 
able  for  sensor  mounting,  especially  with  a  "smart"  weapon 
(one  which  Impacts  at  the  aiming  point).  If  a  free  choice 
Is  possible  among  these  options  then  the  stable  platform 
"smart"  weapon  system  with  slewing  control  Is  optimal.  A 
positional  control  stick  Is  best  for  all  phases  of  this  mission. 
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IMPLICATIONS 


Remotely  piloted  vehicles  for  strike  missions  can  cer¬ 
tainly  be  automated  far  beyond  the  levels  considered  in  this 
study.  They  may  be  pre- programmed  to  navigate  to  fixed  enemy 
tarqets,  and  return  for  recovery  without  ouidance  from  the 
control  station.  Certainly  such  autonomous  behavior  reduces 
the  danqer  o<r  detection,  exposure  to  ECM.and  enemy  defensive 
weapons . 

Such  automation  can  only  be  achieved  at  considerable  ex¬ 
pense.  ..hjt  cost  has  been  a  key  concern  ever  since  the  initial 
RPV  concept.  If  such  weapons  are  to  be  available  in  adequate 
numbers,  they  must  be  of  low  cost  and  with  less  automation,  thus 
there  is  qreater  dependence  on  the  remote  human  operator. 

In  addition  to  performing  enroute  guidance  and  flight  con¬ 
trol  in  addressing  the  target,  he  can  select  alternative 
targets  of  opportunity.  He  can  evade  enemy  weapons  or  other 
threats  and  monitor  the  developing  situation  with  respect 
to  weather,  the  performance  of  the  vehicle,  the  adequacy 
of  any  required  support  functions,  and  so  forth.  The  above- 
described  experiments  served  to  clarify  certain  ambiguities 
relating  to  the  suitability  of  manual  control  modes  as  these 
might  be  called  upon  for  performing  the  RPV  strike  mission. 

These  results  provide  a  foundation  for  designing  less  costly 
RPV  systems  and  for  performing  the  necessary  trade-off  to 
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determine  the  most  suitable  level  of  avionic  sophistication. 
By  direction,  this  study  did  not  concern  target  detection  per 
sc,  In  that  th  i  s  has  been  studied  elsewhere.^*  **•  ^ 

Preliminary  attention  was  focused  upon  RPV  attitude 
control.  The  classic  conflict  between  Inside-out  and  out- 
slde-ln  modes  of  attitude  display  was  addressed  using  sub¬ 
jects  ranging  In  experience  from  naive  through  fully  guall- 
fled  Navy  attack  pilots.  In  spite  of  significant  pilot  train¬ 
ing  and  experience,  a  natural  pre-disposition  appeared  In 
favor  of  the  octslde-ln  mode  (even  though  the  pilots  could 
perform  egually  well  using  either  mode).  Replacing  present 
attitude  by  the  expected  attitude  did  not  benefit  performance. 
The  higher  frequency  components  resulting  from  such  linear 
rate  prediction  Imposed  great  difficulty  on  the  non-pilots. 
Although  the  experienced  pilots  could  cope  with  what  appears 
as  greater  turbulence,  they  continue  to  fly  "ahead  of  the 
vehicle"  and  therefore  compound  the  errors  of  prediction. 


.  4  L®[l1ncler»  The  Electro-Optical  System  as  as  Aid  to 

and  Justification  of  Ground  Targets: 

(US  Naval  Missile  Center:  Editorial  Division,  1966). 

2 

R.  A.  Bruns  et  al.  Dynamic  Target  Identification  on  Tele- 
Fu!!c!1on  ?f  D1splay  Size,  Viewing  Distance,  and 
Target  Motion  Rate:  (Naval  Missile  Center:  Editorial  Rranch, 

3 

*4  l D*  F?"ler  an<1  Dr.  Daniel  B.  Jones,  Target  Aqulsl- 
tlon  Studies:  (Martin  Marietta  Corporation,  1972). 

^Daniel  B.  Jones,  A  Collection  of  Unclassified  Technical 
Papers  on  Target  Acquisition:  (Office  of  Naval  Research: 
Mart.n  Marietta  Aerospace,  1972). 
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Apparently,  real  tine  attitude  presentation  Is  satisfactory 
for  RPV  control.  Pursuit  and  compensatory  predictive  attitude 
displays  mioht  also  be  of  some  value,  however,  detailed  ex¬ 
ploration  of  this  did  not  appear  to  he  justified. 

The  positional  mode  of  control  stick  was  found  to  be 
superior  to  the  conventional  rate  control  mode.  Although 
the  position  stick  is  limited  in  attitude,  it  provides  a 
simpler  di sp’ay/control  relationship  and  facilitates  pre¬ 
cise  fliqht  control.  Pilots  evidenced  no  particular  dif¬ 
ficulty  in  usinq  this  mode  of  control.  Ouestion  remains  as 
to  whether  some  nonlinear  positional  mode  stick  miqht  be  su¬ 
perior  to  the  simple  linear  attitude  versus  control  rtick  dis¬ 
placement  function  used  in  this  experiment.  Experiments  in 
this  reqard  are  to  be  conducted  at  the  Human  Enqineerinq  Lab¬ 
oratory,  Naval  Weapons  Center,  Point  Mugu.  The  possibility  of 
combininq  position  and  rate  modes  was  considered,  althouqh  no 
exoeriments  were  performed  in  this  reqard. 

Comparison  of  the  inside-out  and  outside-in  modes  of 
attitude  displays  revealed  that  outside-in  was  better  for 
pitch  control  but  that  inside-out  was  better  for  roll  con¬ 
trol.  It  is  Generally  believed  undesirable  to  mix  modes  of 
display  and  yet  the  experimental  results  indicate  the  benefit 
to  be  realized  by  a  combination  attitude  display  wherein  the 
aircraft  symbol  moves  only  in  pitch  while  the  horizon  sym¬ 
bol  moves  only  in  roll.  In  point  of  fact,  this  combination 
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attitude  display  enables  superior  performance  when  the  sen¬ 
sor  is  fixed  to  the  airframe.  Apparently,  the  aircraft  sym¬ 
bol  movlnq  In  the  vertical  dimension  compensates  for  the  lack 
of  kinesthetic  feedback  which  is  most  pronounced  in  pitch- 
chanqlnq  maneuvers. 

Use  of  a  restricted  field  of  view,  due  to  the  sensor, 
introduces  the  need  for  scallnq  the  horizon  symbol  movement 
so  as  to  properly  reflect  pitch  chanqe  over  a  siqnificant 
ranqe.  But  this  transformation  introduces  a  disparity  be¬ 
tween  the  motion  of  the  artificial  horizon  and  the  background 
In  the  vicinity  of  the  horizon.  The  actual  horizon*  moves 
farther  and  faster  than  the  artificial  horizon,  although 
both  move  In  the  same  direction.  This  difference  in  speed 
can  result  In  an  apparent  opposite  movement  of  the  two  hor¬ 
izons.  This  difficulty  is  not  present  with  the  mov¬ 
ing  aircraft  symbol  since  its  motion  Is  in  the  opposite 
direction.  Here  analn,  the  outside-in  mode  of  display  ap¬ 
pears  to  be  most  suitable. 

Question  remains  as  to  the  suitability  of  this  display 
for  RPV  operators  situated  onboard  another  aircraft  or  ship 
In  that  under  such  circumstance,  the  controller  is  subject 
to  uncorrelated  q-forces.  When  a  stabilized  sensor  mounting 
is  used,  the  outside-in  mode  of  display  should  again  be 
superior. 

*  "Actual  horizon"  referinq  to  the  horizon  as  seen  from  on¬ 
board  the  RPV  through  the  sensor. 
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Sensor  slewing  can  be  of  great  value  but  its  use  depends 
upon  the  nature  of  the  weapon  and  the  sensor  mounting.  In 
general,  the  more  complex  the  pilot's  task  (that  is,  the 
less  the  level  of  automation)  the  less  desirable  slewing 
becomes.  In  the  limit,  a  fixed-to-the  airframe  sensor  forces 
the  pilot  to  identify  the  target  within  a  moving  background 
while  a  stabilized  platform  allows  him  to  observe  a  steady 
field.  Here,  slewing  is  more  desirable.  If  provided  with 
a  "dumb"  weapon,  the  pilot  must  align  the  vehicle  with  the 
target  before  weapon  release,  but  with  a  "smart"  weapon  he 
can  simply  fly  close  to  the  target  and  aim  the  weapon  through 
sensor  slewing.  Obviously,  such  slewing  is  therefore  manda¬ 
tory  for  a  "smart"  weapon.  With  a  "dumb"  weapon,  slewing 
jnly  helps  if  there  is  the  availability  of  a  stabilized 
platform. 

The  experimental  findings  only  concern  a  position  sen¬ 
sor  control  stick  for  slewing  in  two  dimensions  (pitch  and 
yaw).  There  seems  to  be  no  need  for  rate  slewing  sensor 
control.  Disorientation  was  experienced  when  pilots  attempted 
to  slew  and  change  RPV  attitude  simultaneously.  Evidently 
the  subjects  cannot  maintain  separate  orientation  regarding 
the  vehicle  and  the  sensor.  To  overcome  this  problem  the 
pilots  were  instructed  not  to  take  simultaneous  redirection 
of  the  ensor  and  the  aircraft.  This  strategy  removed  the 
difficulty.  Serious  consideration  may  also  be  given  to  use 
of  a  helmet-mounted  display  as  a  less  restrictive  means  for 
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obviating  this  problem.5  Head  movement  is  intrinsically 
sensed  by  the  human  operator  so  that  simultaneous  slewing 
and  aircraft  flight  control  might  be  performed  without 
loss  of  orientation.  Such  a  "heads  up"  display  might  also 
provide  an  omnidirectional  view  from  the  RPV,  provided 
additional  sensors  are  suitably  mounted  and  switched  as  a 
function  of  the  controller  head  movement. 

Penetration  of  enemy  territory  m*y  call  for  low  alti¬ 


tude  flight,  thus  a  pop-up  maneuver  may  be  required  for 
effective  targeting.  Here  manual  slewing  control  is  appro¬ 
priate  although  automatic  slewing  could  be  used  if  there 
has  been  previous  lock-on  to  the  target. 

The  use  of  the  sensor  zoom  capability  requires  an  appro¬ 
priate  strategy.  The  wide  field  of  view  Is  used  In  search 
for  the  tarqet.  Magnification  Is  Increased  for  target 
identification  and  a  fixed  rate  de-zoom  should  be  used  during 
approach  to  the  target.  This  maintains  fixed  sensitivity 
of  aiming  as  the  range  decreases.  In  essence,  the  tarqet 
remains  at  the  same  visual  angle  until  the  point  of  weapon 
release.  In  this  mode,  a  reticle  can  be  used  to  Indicate 
range  to  the  target  and  thus  the  appropriate  time  for  wea¬ 
pon  release.  Alternatively,  the  size  of  the  aircraft  sym¬ 
bol  can  be  used  to  Indicate  range. 


c 
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SUGGESTIONS  FOR  FURTHER  RESEARCH 


Althouqh  only  televisual  sensing  was  simulated  in  this 
study,  it  seems  reasonable  to  extend  the  findings  to  cover 
FLIR  and  other  imaging  sensors.  The  use  of  alternative  fil¬ 
ters,  mul ti -spectral  sensing  or  multiple  sensors  may  enhance 
target  detection,  flight  control  and  mission  performance.®*  7 ,  8 
Reference  is  made  to  the  recent  literature  on  this  matter. 

Only  conventional  shape  displays  were  used  in  this  in¬ 
vestigation.  It  is  possible,  however,  that  the  nature  of  the 
sensor  might  call  for  different  shape  of  display  for  best 
presentation.  Once  again,  the  nature  of  the  mission,  sensor 
capability,  and  the  human  operator  must  be  mated  in  the  design 
of  the  interface. 

The  presentation  of  color  should  aid  the  human  operator, 
particularly  with  respect  to  targeting.  Pseudo-color  (that 
is,  the  introduction  of  color  as  a  function  of  sensed  grey 
scale  level)  may  prove  worthwhile.  Pseudo-black-and-white 
might  be  of  use  in  field  situations  which  cannot  accomodate 


6Rona 1 d  A.  Erickson,  Human  Factors  Research  Techniques  With 
Television.  Naval  Weapons  Center,  China  Lake,  Ca .  ,  NWC  TP 
5072  ,  Janua  ry  1971. 

7R.A.  Bruns,  A.C.  Bittner,  Jr.,  and  R.C.  Stevenson, 

Effects  of  Target  Size,  Target  Contrast,  Viewing  Distance, 
and  Scan  Line  Orientation  on  Dynamic  Televisual  Target 
Detection  and  Identification.  (AIRTASK  A340  531 3/225-B/ 
2F00524001),  August  17  1972. 

8Herschel  C.  Self  and  Steve  A.  Heckart,  TV  Target  Acqui¬ 
sition  at  Various  Frame  Rates.  AMRL-TR-73-1 1 1  ,  Aerospace 
Medical  Research  Laboratory,  Wri ght-Pat terson  Air  Force  Base 
Ohio,  September  1973. 
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the  complexity  of  color  generation.  This  subject  deserves 
a  separate  investigation. 

Stereoscopy  might  also  be  useful  for  improved  targeting. 
However,  sensors  mounted  on  the  wingtips  provide  only  a 
short  baseline  and  thus  restrict  depth  display.  Alterna¬ 
tively,  time  separated  frames  can  be  presented  to  each  eye. 
This  requires  careful  scaling  and,  since  the  baseline  is 
along  the  flight  path,  its  primary  value  is  with  respect  to 
side-looking  targets.  Another  possibility  is  use  of  tha 
forward  air  controller's  sensor,  thus  providing  a  very  large 
baseline.  Here  thire  should  be  great  stereoscopic  depth, 
but  sophisticated  data  processing  would  be  required  to  main¬ 
tain  proper  scaling.  Holographic  displays  may  find  applica- 
q 

tion  here. 

Additional  instrumentation  should  provide  the  operator 
with  data  pertinent  to  mission  performance.  There  might 
well  be  vertical  tape  displays  of  the  kind  found  in  modern 
aircraft,  energy  management  displays  using  predictive 
indices,  displays  which  flag  unusual  circumstance  or  emergency 
conditions,  auditory  displays  which  replace  the  pilot's 
visual  monitoring  of  conditions  by  audition  and  olfaction. 
Particular  attention  should  be  given  to  the  display  of  ECM 
or  weapon  illumination  and  to  the  use  of  burst  communication 
for  additional  security.  Significant  portions  of  the  mission 
could  be  in  an  autonomous  mode.  Various  studies  have  examined 
video  presentation  and  modified  frame  rates. 

g 

T.J.  Harris,  R.S.  Schools,  G.T.  Sincerbox,  L).W.  Hanna, 
D.G.  Delay,  "Holographic  Head-Up  Display  --  Phase  II  Final 
Report"  JANAIR  Report  680709,  March  27,  1970. 
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Further  studies  are  required  to  determine  multiple 
RPV  operational  procedures.  Enroute  control  may  well  be 
separated  from  conduct  of  the  crucial  maneuver  in  view  of 
difference  in  function  and  the  desirability  of  providing 
a  single  operator  with  repetitive  control  of  the  direct 
attack.  The  displays  and  controls  for  these  operators 
shoulu  be  considerably  different  (as  indicated  above). 

In  what  way  should  RPV  operations  be  integrated  with 
those  of  manned  aircraft  in  the  performance  of  strike 
missions?  To  what  extent  do  the  above  findings  relating  to 
the  strike  mission  carry  over  to  reconnaisance  missions 
and  other  requirements?  Are  there  ways  to  select  and  train 
RPV  pilots  so  as  to  relieve  the  requirement  on  those  pilots 
already  trained  to  fly  manned  aircraft?  These  and  other 
questions  may  be  addressed  as  an  extension  of  this  investi¬ 
gation. 
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APPENDIX  A 


Design  and  Methodology  for  Experiment  I 

Data  were  taken  to  permit  a  factorial  design.  The  var¬ 
ious  effects  considered  included  the  three  groups  of  pilots 
(Navy  Attack  Pilots,  Model  Aircraft  Pilots,  and  Engineer  Non- 
Pilots),  the  attitude  display  (outside-in  versus  inside-out), 
the  attitude  control  stick  mode  (position  versus  rate),  and 
the  use  of  predicted  attitude  (prediction  versus  no  predic¬ 
tion).  The  experiment  was  planned  to  allow  each  subject  to 
fly  each  display  control  combination  at  least  once  over  each 
scenario,  that  is,  16  runs  per  subject.  A3x2x2x2 
balanced  factorial  design  was  established.  The  desired  data 
were  incomplete  on  some  subjects  due  to  machine  malfunctions 
and  other  problems.  To  compensate,  the  data  were  analyzed 
by  the  General  Linear  Model  Method  which  provided  the  capa¬ 
bility  for  using  unequal  numbers  of  observations  in  each  cell. 

The  General  Linear  Model  had  sufficient  sample  size  to 
allow  for  estimation  and  testing  of  interaction  and  the  sig¬ 
nificance  of  differences  between  the  design  variables  with 
respect  to  dependent  variables  of  flight  control  (cross-track 
error)  and  targeting  (in  terms  of  miss  distance).  The  model 
also  allowed  for  statistical  control  of  learning  in  the  use 
of  run  order  as  a  covariate,  thus  the  order  of  display  pre¬ 
sentation  was  randomized  for  each  subject. 

There  were  two  dependent  variables;  the  cross-track 
error  averaged  across  both  scenarios  for  each  display  con¬ 
trol  situation  for  each  subject  yielding  eight  obervations. 
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and  the  m<ss  distances  at  the  end  of  each  run,  thus  provid¬ 
ing  a  total  of  16  observations  for  each  subject  (two  for 
each  display  control  situation).  Note  that  niss  distances 
greater  than  iO.OOO  feet  were  discarded  as  the  suhiect  was 
considered  not  to  have  seen  the  target  any  tine  during  the 
mission. 

program  was  written  to  monitor  the  performance  in 
terns  of  flight  control  capability  and  ability  to  perform 
the  crucial  maneuver.  Input  data  concerned  the  particular 
scenario,  the  eight  different  display/control  situations, 
four  continuous  and  seven  discrete  variables  as  a  function 
of  real  tine.  these  variables  included  airspeed  in  knots, 
altitude  in  feet,  cross-track  error  in  nautical  miles,  prob¬ 
ability  of  success  (hitting  the  taroet),  north-south  miss- 
distance  in  feet,  east-west  niss-di stance  in  feet,  time  of 
target  defection,  total  on-tine  of  sound  in  the  secondary 
task  in  seconds,  total  fliolit  time  in  seconds,  and  impact 
angle  (recorded  only  when  there  was  a  hit). 

Discrete  variables  were  part  of  the  printout.  The 
cross-track  error  and  probability  of  success  were  manually 
integrated  through  use  of  a  planineter.  Airspeed  and  alti¬ 
tude  were  reduced  by  establishing  three  critical  points  along 
the  scenario  wherein  nominal  airspeed  and  altitude  errors 
occurred.  In  addition,  the  instructed  airspeed  and  alti¬ 
tude  profiles  were  referenced  in  order  to  obtain  integers 
representing  the  total  number  of  excessive  deviations  from 
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the  instructed  profile,  that  is,  errors  beyond  +  150  feet 
in  altitude,  +_  20  knots  in  airspeed.  The  total  nunber  of 
instances  wherein  these  limits  were  exceeded  were  counted 
by  mission  phase  in  order  to  provide  a  measure  across  sub¬ 
jects  . 

Specifically,  the  intent  here  was  to  identify  only 
significant  errors  in  flight  control.  If  the  subject  main¬ 
tained  the  initial  thrust  setting  of  90  percent,  his  alti¬ 
tude  descent  would  alnost  certainly  fall  w i thin  this  toler¬ 
ance  up  to  about  one  mile  from  the  target.  At  that  point, 
a  deliberate  effort  is  required  by  the  pilot  to  descend  to 
the  proper  altitude  in  order  to  impact  the  target.  Thus, 
naive  subjects  who  choose  not  to  control  this  variable  unLil 
the  very  end  were  not  penalized.  However,  pilots  could  well 
take  advantage  of  the  additional  flexibility  afforded  through 
thrust  control  and  better  execute  the  mission  well  within  the 
tolerance,  both  with  respect  to  altitude  and  airspeed. 

The  particular  tolerances  chosen  were  determined  throuqh 
pieliminary  measurements  on  both  pilots  and  naive  subjects 
thus  taking  into  account  the  effect  of  turbulence  at  low 
altitude.  A  symmetrical  error  weighting  was  chosen  in  view  of 
thp  danger  of  clobber  on  the  low  side  and  of  missing  the 
target  through  overflight  on  the  high  side.  The  airspeed 
tolerance  was  also  symmetrical  about  the  instructed  airspeed 
in  view  of  the  danger  of  stall  and  of  having  too  short  a 
time  to  perform  the  crucial  maneuver.  Within  these  para¬ 
meters,  subjects  who  made  long  but  controlled  individual 


excursions  outside  the  tolerance  were  penalised  as  much  as 
those  who  made  single  short  excessive  deviations  in  cither 
direction.  this  experiment  the  object  was  not  to  score  the 
ability  to  perform  accurate  flight  control  but  rather  to 
i-e-ain  within  the  acceptable  band  of  performance. 

The  computer  simulation  proqran  represented  the  dynamics 
of  the  vehicle  in  its  flight  over  the  terrain  and  proviso 
some  degree  of  automated  data  reduction.  A  portion  of  the 
recorded  data  appeared  on  paper  tape,  a  portion  on  the  ground 
track  plotter  and  a  portion  on  the  console  typewriter.  To 
illustrate,  the  computer  generated  pilot  performance  as  in¬ 
dicated  in  Figure  6  .  which  shows  the  Mot  and  the  ground 
track  course  of  a  subject  flying  „Uh  an  (ns)rte.out  prcscn. 

tation.  without  prediction,  and  with  rate  stick  control. 

This  particular  trace  was  generated  by  a  Model  Aircraft  Pi,0t/ 

Subject  on  mission  profile  no.  !.  The  solid  curve  represent^ 

the  ground  track  while  the  dashed  curve  represents  the  in- 

tended  course  in  three  phases.  !„  Phase  A.  the  subject 

attempted  to  maintain  952  thrust  and  descend  to  1.000  feet. 

in  Phase  C.  he  intended  to  maintain  the  thrust  and  descend 

to  000  feet.  In  Phase  C.  he  was  instructed  to  reduce  his 

speed  to  about  300  knots  and  enter  the  target  domain  at  an 
altitude  of  200  feet. 

figure  7  illustrates  the  performance  nf  a  subject  In 
terns  of  his  altitude  profile,  probability  of  success,  and 
corresponding  terminal  performance  as  indicated  by  the  com¬ 
puter  program.  Specifically,  the  probability  of  success 


mmmm 


w 

O 


Cl 

<1 


C_ 

«/> 


e 

in 

o 

o 


Q. 

< 


3 

CL 


3 

O 


CM 

i 


i 

cn 


<u 

o 

i /> 

c 

1 

u 


h- 

<. 

C. 


C 

1C 


E 

fc. 

0> 


• 

C  ion 

K' 

u.  on 

i 

iO 

2  Cl.  in 

CM 

<.  P  n 

lx 

—1  r-l  | 

2 

CL  1 

or 

t— 

< 

z 

o 

— J 

M 

lx 

»- 

C. 

*-< 

o 

z 

£ 

c 

LU  O 

c.  o 

iiJ 

Z  b. 

T2 

t—  a 

M 

Khl- 

x< 

H 

t  C  W  !-  h 

C  C  «* 

-l  lx 

-J 

z  ix  <  c 

< 

> 

c: 

CL 

< 

C 

or 

I- 

IM 

a 

t 

c 

•** 

lx 


Sample  Output  of  Type  Model  A/C  Pilot  Performance 


program  calculated  a  variable  ranging  from  zero  to  one  at 
every  time  frame  during  the  simulated  flight,  this  prob¬ 
ability  being  calculated  as  the  product  of  three  expecta¬ 
tions:  the  probability  of  target  detection,  the  probability 
of  collision  with  the  ground,  and  the  probability  of  loss  of 
the  RPV  due  to  ground  fire  (these  latter  two  probabilities 
being  empirical  functions  of  altitude  only).  In  essence, 
these  probabilities  took  the  form  of  exponential  functions, 
the  former  descending  from  1.0  at  zero  altitude  to  zero  at 
400  feet,  the  latter  beginning  at  600  feet  and  rising  to 
about  0.4  at  1600  feet. 

The  General  Linear  Model  provided  a  methodology  for  es¬ 
timating  the  effects  of  several  independent  variables  and 
their  interaction  with  a  deoendent  variable.  An  eguation 
was  derived  expressing  the  dependent  variable  as  the  sum  of 
various  independent  variable  effects,  interaction  effects  or 
covariate  effects  (See  Tables  1A,  IB  and  1C).  The  independent 
variables  were  discrete  cl  ass i f i catory  variables  and  the 
analysis  reguired  observation  of  at  least  one  value  of  the 
dependent  variable  for  each  particular  combination  of  inde¬ 
pendent  variables  (with  more  than  one  being  needed  for  esti¬ 
mation  of  interaction).  The  covariate  for  the  exercise  had 
to  be  an  ordinal  variable.  An  observed  covariate  val je  was 
needed  for  each  corresponding  observation  of  the  dependent 
variable. 
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In  this  particular  case,  the  dependent  variable  (be¬ 
ing  cross-track  error  or  ni ss-di stance )  was  presumed  to  be 
affected  by  the  independent  variables  of  grouns  of  pilots, 
node  of  attitude  display,  tine  scaling  of  attitude  disnlay, 
mode  of  control  stick  operation,  and  the  covariate  run  order 
(that  is,  the  sequence  of  the  particular  display  combination). 

In  this  case,  the  general  linear  model  precluded  the 
possibility  that  the  variation  of  dependent  variables  could 
be  accounted  for  by  differences  in  the  groups,  differences 
between  the  predicted  and  non-predi cted  attitude,  difference 
between  the  position  and  rate  stick  nodes,  interactions 
between  the  independent  variables  and  the  effect  of  the  co¬ 
variate  run  order  (which  is  a  reflection  of  learning). 


TABLE  1 A 

General  Linear  Model  Equation 


Xmi  jk£ 


where 


"•WW  GVU  *  GSik 
V>V  *  SPU  *  GVSijk  *  GVP1Jt  *  GSP 
B*Rmijki  +  emijk£ 


+  6PU  +  VSjk  + 
m  +  VSPjk.  +  GVSPiju+ 


1  *  1,2,3 
j  -  1.2  * 
k  *  1,2  = 

%  -  1 ,2  = 

Xm1  jkf.  * 


...,8  for  cross-track  error\  _  „ 

.,16  for  miss-distance  j  =  repetit1on  number 

*  group 

attitude  display  presentation  mode  number 
control  stick  mode  number 
attitude  prediction  mode  numbers 
dependent  variable  Across- track  error  or  miss  distance 


1 

t 


M  *  overall  mean 
*  group  effect 

G^  *  Navy  Attack  Pilot/Subject  effect 
G2  *  Model  Aircraft  pilot/Subject  effect 
G3  =  Engineer  Subject  effect 
Vj  *  altitude  display  effect 

*  Inside-out  mode  effect 
V2  s  Outside-in  mode  effect 
Sk  =  control  stick  effect 

=  Rate  stick  mode  effect 
$2  =  Positional  stick  mode  effect 

P^  *  prediction  effect 

P^  =  Prediction  mode  effect 
P2  =  No  prediction  mode  effect 
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GV...,  GSjk.  GPU.  VSU.  VPjt.  SPk(  -  second  order  interaction  effects 
GVSi ;  L .  GVPU,.  GSPut,  VSPju  .  third  order  interaction  effects 


'ijk 


rucp  =  fourth  order  interaction  effect 

bVDri jkt 

b  =  coefficient  of  the  covariate 

r  -  covariate,  run  order  =  order  in  which  the  mth  subject  from 

m  i  j  k  t 

group  i  "flew"  display  combination  j k* 

R  ...#  =  1,2 . 8 

mi  j  k  9 

e  =  random  error  inherent  in  performance,  assume  aero  mean  for 

m  i  j  k  i 


e  and  homogeneous  variance, 

mi  j  kt 
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APPENDIX  B 

Equipment  Description 


Equipment  used  in  Experiments  II,  III,  and  IV 


Control  Console: 

The  pilot/subject's  console  was  modified  from  a  two- 
place  side-by-side  cockpit.  The  controls  consisted  of  a  con 
ventional  center  stick  for  pitch  and  roll  control.  Pitch 
and  roll  trim  functions  were  provided  by  a  trim  switch  on 
the  control  grip.  Conventional  rudder  pedals  wore  used  for 
yaw  control  with  trim  being  provided  by  a  switch  on  the  left 
console.  The  left  console  also  Included  a  throttle  and 
sensor  slew  control  Stic1'.  The  sensor  slew  control  stick 
provided  <.wo-axis  slew  control.  The  control  had  a  detent 
center  position  and  was  otherwise  unconstrained  so  that  it 
would  remain  where  positioned.  A  zoom  switch  was  mounted 
on  the  sensor  control  handle. 

The  instrument  panel  is  illustrated  in  Figure  8  . 
Directly  in  front  of  the  pilot  was  located  a  conventional 
two-axis  attitude  direction  indicator  (ADI).  Directly  be¬ 
low  the  ADI  was  a  horizontal  situation  indicator  (MSI).  To 
the  left  of  these  instruments  were  an  airspeed  indicator, 
an  altimeter,  rate  of  climb  indicator,  sideslip  angle  indi¬ 
cator,  g-meter,  and  aviation  clock.  To  the  right  of  the 
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ADI-HSI  instruments  was  a  control  surface  position  indicator 
and  a  timer. 

Test  Conductor's _Co ntrol  Pane  1 : 


The  test  conductor's  control  panel  was  hand-hela  and 
cable-mounted  so  that  the  test  conductor  could  adopt  the  most 
convenient  location  for  monitoring  the  experiment.  The  box 
contained  three  push  buttons  for  controlling  the  simulation 
mode,  ten  switches  for  program  options,  and  a  four-position 
switch  for  selecting  map  options. 

Visual  Display  Mon i tor : 

Directly  in  front  of  the  subject  was  a  21-inch  video  moni- 
tor  driven  by  the  visual  display  generator.  The  sensor  image 
was  presented  on  this  monitor  along  with  other  symbology  such 
as  cross-hairs  and  a  moving  or  fixed  aircraft  symbol.  At 
the  lower  left  corner  of  the  monitor  were  located  three  indi¬ 
cators  showing  the  sensor  orientation  angles  relative  to  the 
vehicle. 

Visual  D i  s p  1  ay  _G e ne ra  to  r  : 

The  visual  display  generator  consisted  of  a  TV  camera, 
optical  bed,  carriage  system,  and  roller  map  assembly.  Two 
large  transparencies  of  the  terrain  were  mounted  on  the  map 
assembly.  One  of  toese  was  approximately  nine  feet  wide  by 
30  feet  long  at  a  scale  of  1500:1.  This  map  represented 
the  terminal  terrain  area  to  be  used  for  low  altitude  flight. 

A  continuous  strip  six  feet  wide  and  thirty  feet  long  at 
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a  scale  of  15000:1  was  used  for  higher  altitude  enroute 
flight  phases.  The  computer  system  generated  the  motion 
command  and  automatically  synchronized  motion  and  positions 
between  the  maps.  The  visual  display  generated  aircraft 
camera  motion  by  travel  along  two  carriages,  movement  of 
the  map  assembly,  rotation  of  a  Pechan  Prism,  and  vertical 
and  horizontal  motion  of  the  wide  angle  lens.  The  motion 
of  the  map  assembly  produced  north-south  motion.  The  outer 
carriage  produced  east-west  motion,  and  the  inner  carriage 
produced  altitude  changes.  The  camera  bed  was  incline!  to 
look  down  at  the  map  with  a  15  degree  angle  from  the  hori¬ 
zontal.  The  field  of  view  of  the  wide-angle  lens  was  *  80 
degrees  while  the  camera  field  of  view  was  +  15  degrees. 

By  translating  within  the  wide-angle  lens  field  of  view,  the 
camera  field  of  view  could  be  yawed  or  pitched.  A  Pechan 
Prism  was  then  used  to  roll  the  image  and  complete  the  three- 
axis  rotation  set. 

Camera  : 

The  video  camera  viewed  a  portion  of  the  imaqe  pro¬ 
duced  by  the  optical  system.  This  portion  represented  a 
field  of  view  30  degrees  wide  by  24  degrees  high.  The  cam¬ 
era  was  a  high  resol uti on.  ..  900  line  camera.  The  camera 
control  electronics  also  included  hardware  which  allowed 
the  superposition  of  other  images  cn  the  video  picture.  This 
feature  was  used  to  simulate  the  novinq  aircraft  symbol, 
artificial  horizon  combination  displays,  ana  gunsight  reticle. 
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Video  Monitor  Displays; 

several  graphic  heads-up  displays  were  generated  on 
the  video  monitor.  This  was  done  by  using  the  aircraft 
attitude  outputs  from  the  analog  computer  to  drive  various 
symbols  on  an  oscilloscope.  This  oscilloscope  was  viewed  by 
a  separate  video  camera.  The  signals  from  this  camera  were 
nixed  with  the  signals  from  the  camera  viewing  the  moving 
map  terrain. 

Three  attitude  displays  were  generated,  an  aircraft 
symbol,  an  artificial  horizon,  and  a  combination  display. 

See  App--dix  tl  for  further  discussion  of  the  combination 
display.  A  gunsight  reticle  was  also  generated  in  this 
manner.  Further  discussion  of  the  gunsight  is  found  in 
Appendix  J. 

D  i  s  p  1  ay  -  C  on  t  r  oJ_  Configuration  : 

Figure  8  provides  a  layout  of  displays  used  in  this 
experiment.  A  C!:T  display  was  located  at  eye  level  directly 
aaove  the  instrument  panel.  The  essential  instruments  for 
this  experiment  were:  the  two-axis  ADI,  airspeed,  altimeter, 
vertical  speed  indicator,  control  surface  indicator,  clock, 
and  video  displays.  Other  instruments  available  to  the  sub¬ 
ject  were  accelerometer,  Horizontal  Situation  Indicator, 
sideslip  meter,  and  sensor  angles.  Controls  available  for 
the  subject  were:  throttle,  potentiometer  for  sensor  align¬ 
ment,  trim  switch,  and  an  aircraft  control  stick  (in  propor¬ 
tional  or  rate  mode) . 
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Equipment  Configuration: 

The  major  components  may  be  listed  as  follows: 
COMCOR  CI-5000  Analoq  Computer-implements  vehicle 
simulation 


Analoq  to  Digital  Converters  j 
D i q i t a  1  to  Analoq  Converters  ) 


i nput-outnut 
processors  for 
displays  and  control 


Xerox  Data  Systems  SDS  9.10  Diqital  Computer 
Controlled  video  camera  pointino  angles. 
Controlled  communication  between  test  conductor 
and  vehicle  simulation. 


Calculated  discrete  values  for  data  reduction. 


Operators  (pilot)  console  (RPV  controls  and  displays) 
Test  Conductor  Control  Panel 
V i deo  Moni tor 
Visual  Display  Generator 
Itovinq  Map  Assembly 
Camera  and  Carriaqe  System 
Video  Symbol  Generator 
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COCKPIT  INSTRUMENTATION 


Attitude  Director  Indicator  (ADI) 

Roll  Angle 
Pitch  Anqle 
Turn  Rate 
Raw  G1 i des 1  ope 

Horizontal  Situation  Indicator  (l!SI) 

Course  (Set  by  the  Navigation  Systen) 

Heading  Command 
Heading,  True 

Heading  Error  (Difference  between  Heading  and  Course) 
A 1 t i meter 

Airspeed  Indicator 

Rate  of  Climb  Indicator  (Vertical  Speed  Indicator) 

Normal  Accelerometer 

Sideslip  Angle  Indicator  -  (Beta) 

Mission  Time  Digital  Clock  -  Elapsed  time  in 
seconds  from  the  start  of  the  mission. 

Control  Surface  Indicator 
Rudder  Angle 
Elevator  Anqle 
Aileron  Angle 
Angle  of  Attack  -  (Alpha) 

Relative  Sensor  Position  -  Display  of  aircraft  atti¬ 
tude  relative  to  the  TV  camera  attitude 
Camera  Pitch  Angle 
Camera  Yaw  Angle 
Camera  Roll  Angle 
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Video  nonitor  heads-up  displays 
Aircraft  Symbol 
Artificial  Horizon 
Combination  Display 
Gunsight  Reticle 

CONTROL  INPUTS 

Flight  Controls 

Center  Stick  -  elevator  and  ailerons 
Rudder  Pedals 

Pitch  Trim,  Roll  Trim,  and  Yaw  Trim 
Camera  Controls 

Control  Stick  -  pitch  and  yaw 
Zoom  Control 

Auxiliary  Controls  (located  on  Flight  Control  Stick) 
Weapon  Release 
Target  Recognition 
Test  Conductor-Observer  Controls 

Mission  Parameter  Entry  Keyboard  and  Printer  Console 
Mission  Initiate,  Terminate,  and  Abort 
Camera  and  Symbology  Modes 
Disturbance  Initiation 
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APPENDIX  C 
Mission  Simulation 
for  Experiments  II,  III,  and  IV 


Flight  Simulation 

The  RPV  Mission  Simulator  consists  of  four  major  blocks: 
the  aircraft  simulation,  the  control  and  evaluation  proqram, 
the  operator  and  test  conductor  stations,  and  the  visual 
display  generator.  The  relationship  of  these  components  is 
illustrated  in  Figure  9. 

The  RPV  simulation  is  a  s i x-deqree-of-f reedom  simulation 
implemented  on  a  COMCOR  CI-S000  Analog  Computer .  The  aerody¬ 
namic,  mass  property,  and  thrust  data  for  this  simulation  was 
extracted  from  the  report  AFFDL- FGC-TM-72- 1 8  "The  Simulation 
Specification  for  the  FDL-23  Remotely  Piloted  Vehicle".  Lin¬ 
ear  aerodynamics,  in  general,  were  used  to  simulate  the  vehicle 
(the  exception  was  the  Implementation  of  a  quadratic  drag 
polar).  The  data  and  equations  are  expressed  In  body  axes. 

The  three  force  and  three  moment  equations  are  imple¬ 
mented  as  follows: 
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The  quantities  in  parentheses  in  the  above  equations 
were  set  on  potentiometers  by  the  digital  computer  and  were 
invariant  during  each  run.  The  normal  variation  of  these  coef¬ 
ficients  with  Mach  number  and  altitude  was  ignored  for  the 
purposes  of  these  experiments. 

The  force  and  moment  equations  were  used  for  integrat¬ 
ing  the  body  angular  and  linear  velocities  as  follows: 


H  *  Fz  +  g  cosecos*  +  QU 

U  «  Fx  -  g  sine  -  QW 

V  ■  F  +  g  cosesin*  -  RU  +  PW 


(/) 

(8) 

(9) 

(10) 

(ID 

(12) 


The  following  Euler  angle  equations  were  implemented  for 
integrating  body  angles.  The  usual  gimbal  -  lock  restriction 
prevents  loops  and  the  particular  analog  computer  implementation 
requires  that  p.tch  angle  remain  within  plus  or  minus  90  degrees. 
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(13) 


6  =  Q  cos*  -  r  sir,, 


y  =  <R  c°s*  ►  Q  sin*)/cose 
v  "  P  +  fs  i  ne 


The  body  axes  velocities  were  converted  to 
velocities  by  the  following  equations: 


i nertia  1 


(14) 

(15) 
axes 


X  -  U(cosycos9)  ♦  V  (costs inesin*  -  sintcos*)  + 

W(costsinecos<p  +  sintsin*)  ^ . 

T  =  U(sintcose)  +  V(s inf sinesin*  +  costcose)  + 

W( s i nt s i nocos*  -  costsin*)  ^ 

H  *  U(sin9)  -  Vfcososin*)  -  W(cosecos<t)  (] 

Simplified  flight  control  systems  were  implemented  to 
9lve  the  operator  a  choice  between  a  proportional  rate  and  a 
proportional  attitude  control  system,  m  the  first  mode,  the 
operator  commands  pitch  rate  and  roll  rate.  In  the  second 
mode,  he  command,  flight  path  angle  and  bank  angle.  both 


cases,  a 

yaw 

damper 

is  used  in  the  rudder  control  system. 

While  in 

rate 

mode , 

the  following  equations  apply; 

Je 

'  Ki 

5P I TCH 

+  kq  Q 

(19) 

6  = 
a 

K2 

6roll 

+  Kp  P 

(20) 

6  = 

r 

K3 

5yaw 

(s"  ♦  t)kr  r 

(21) 

While  in 

attitude  mode,  the  following  control  equations 

apply: 

«e  = 

K4 

6P I TCH 

*  kq  1  *  Kr  ? 

(22) 

«.  = 

S 

5roll 

(23) 

«r  = 

*3 

5yaw 

■(r+T)"«  ’ 

(2*) 
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While  all  the  above  equations  are  simulated  on  the  ana¬ 
log  computer,  the  equations  for  controlling  the  video  camera 
are  located  in  the  Xerox  Data  System'  XDS  930  Digital  Compu¬ 
ter.  The  video  camera  can  be  controlled  as  if  it  had  0,  1, 

2,  or  3  degrees  of  freedom  and  with  and  without  zoom.  Con¬ 
trol  of  each  degree  of  freedom  can  be  proportional,  smoothed, 
or  inertially  stabilized.  When  operated  in  a  direct,  propor¬ 
tional  mode,  the  control  equations  are  simply: 


CAMERA 

’command 

(25; 

CAML.RA 

6C0MMAND 

(26) 

CAMERA 

«  0 

(27) 

W hen  the  camera  is  inertially  stabilized,  the  following  equa¬ 
tions  are  used: 


tcamera  c  '‘'command 


-/(■ 


R  +  (P  cos  ¥cahera  + 


Q 

r 

s  i  n 

'‘‘camera^ 

tan 

0  CAMERA  dt  (28) 

CAMERA  =  6C0MMAND  ' 

t 

cos 

^CAMERA  " 

P 

s  i  n 

'’’CAMERA)dt(29) 

CAMERA  *  '  i 

rpp 

cos 

4  CAMERA  + 

0 

s  i  r. 

^’camera* 

J 

sec  6 

camera]  dt 

(3C) 

When  the  camera  is  operated  in  a  smoothed  mode,  the  equations 
are  modified  in  wash-out  circuits  as  follows: 


'•’camera  =  '’’command 


-  V  ffo  + 
T-TTl/l 


(p  cos  '‘'camera  + 


Q  sin  '‘'camera ^  tan  °camera1  dt 


(31  ) 
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°CAMERA  s  0COMMAND 


CAMERA 


V 


(0  cos  *CAMERA  - 

P  sin  ’camera^  dt 


(32) 


-*5+7  [  ( p  cos  '»'CAf1frpA  + 

S  0  sin  '‘'CAMERA*  sec  ^CAMERA]  dt  (33) 


All  the  above  equations  are  simulated  on  the  analog 
computer . 


SLEW  AND  ZOOM 

The  pilot  controlled  the  camera  with  a  sensor  control 
stick  mounted  on  the  left  console  in  the  cockpit.  The  stick 
was  capable  of  two-axis  rotation  (fore  and  aft,  riqht  and 
left)  and  had  a  two-position  switch  on  top  of  the  grip  for 
zoom  control.  The  zoom  switch  had  a  spring  return  to  zero 
only  for  zooming  out  to  the  target.  Consequently,  for  zooming 
In,  the  pilot  could  pull  the  switch  back  and  leave  it,  allow¬ 
ing  the  sensor  to  complete  zooming  in  without  additional 
actuation.  The  maximum  slew  angles,  time  constants,  zoom 
rate,  degrees  of  freedom,  and  stabilization  mode  were  entered 
Into  the  digital  computer  program  and  could  be  changed  be¬ 
tween  runs  from  the  teletype.  Three  modes  of  control  could 
be  selected: 

0  Degrees  of  freedom  -  fixed  camera 

1  degree  of  freedom  -  pitch  control  only 

2  degrees  of  freedom  -  pitch  and  yaw  control 

In  each  of  the  control  modes  the  following  stabilization  modes 
could  operate: 
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No  Stabilization 
Smooth i ng 

Pitch  Stabilization 

Pitch  and  Roll  Stabilization 


The  stabilization  equations  were  as  follows: 


AQcamera 

A<t>came  ra 


-Q* 

_(P* 


COS  <1/ 

COSY 


camera 

camera 


+ 


+ 


P*  sin  ^ 
Q*  sin  y 


camera 

camera 


)/cos  o 


camera 


where  '*'capiera,  0camer;>,  and  4>camer&  were  the  respective  yaw, 
pitch,  and  roll  camera  angles  and  P  and  Q  were  the  body  axis; 
roll  and  pitch,  angular  rates. 

Yaw  stabilization  of  the  camera  was  examined  and  found 
undesirable.  This  resulted  from  the  fact  that  yaw  stabili¬ 
zation  resulted  in  the  camera  looking  off  at  a  yaw  angle 
after  a  heading  change.  There  was  no  immediate  cue  to  the 
pilot  that  that  had  happened  and  consequently  all  his  trans¬ 
lation  cues  were  confused  and  he  had  great  trouble  flying 
to  a  point  on  the  terrain. 

The  simulation  video  did  not  Include  a  zoom  lens,  con¬ 
sequently,  zoom  was  simulated  by  modifying  the  camera  posi¬ 
tion  to  bring  it  closer  to  the  terrain  as  the  camera  "zoomed" 
out  and  retract  it  in  response  to  zoom  in.  The  zoom  calcu¬ 
lations  were  normally  about  the  point  In  the  center  of  the 
screen  but  were  limited  to  3"  lookdown  whenever  the  camera 

was  pointed  at  a  higher  elevation.  The  following  equations 
applied: 
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H' 

X' 

X' 


H/  zoom 

1 -zoom 


X  + 
Y  + 


zoom 
1 -zoom 
zoom 


H  ctnQ  cosy 
H  ctnQ  siny 


The  normal  field  of  view  for  the  camera  system  was  30  degrees 
wide  by  24  degrees  high.  The  full  zoom  position  magnified 
the  image  by  a  factor  of  two  to  produce  a  field  of  view  of 
15  degrees  of  width  and  12  degrees  of  height. 

Digital  Computer 

The  test  conductor  initiated  each  experimental  run 
through  a  control  box.  Additional  switches  allowed  him 
to  introduce  control  transients  and  accept  or  reject  runs. 

The  digital  computer  handled  the  communication  between  the 
operator  and  the  vehicle  simulation  on  the  analog  computer. 
Intermediate  data  was  stored  on  magnetic  tape  for  later  pro¬ 
cessing.  The  analog  computer  potentiometers  were  set  by  the 
digital  computer  in  response  to  input  aerodynamics  and  vehicle 
characteristics.  Between  runs,  the  test  conductor  could 
change  program  variables  through  a  teletype  located  at  the 
cockpit.  Scoring  and  evaluation  were  also  performed  in  the 
digital  computer. 

The  flow  diagram  of  the  digital  computer  simulation  tasks 
is  shown  in  Figures  10  and  11. 
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FIGURE  10 

RPV  MISSION  DIGITAL  COMPUTER  PROGRAM 


FIGURE  11 


RPV  MISSION  SIMULATION 
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appendix  d 

Performance  "easurcmcnt  System  for  Experiment  II,  III  and  IV 

Too  metliods  of  observing  and  recording  pilot  performance 
were  utilized.  In  both  cases  most  of  the  results  were  avail¬ 
able  after  each  repetition;  however,  some  of  the  variables  re¬ 
quired  off-line  computer  processing  or  manual  processing. 
Oscillograph  Recording  -  a  multichannel  oscillograph  recorder 
was  utilized  during  some  runs  to  generate  graphic  presentations 

the  flight  profile.  Six  channels  were  connected  to  qive 
o  continuous  recording  of: 

A 1 t i tude 
Vel oci ty 

Lateral  Displacenent  fron  360°  Heading 
Yaw  Camera  Motion 
Pitch  Camera  Motion 
Zoom  Usage 

This  method  was  not  ooerative  for  all  flights  and  was  used 
only  to  observe  typical  flight  profiles.  This  method  was 
not  used  to  generate  data  for  scoring  purposes. 

Il^etic  Tape  Recording  -  the  second  method  utilized  was  that 
of  recording  various  variables  on  magnetic  tape.  The  follow¬ 
ing  variables  were  recorded  for  the  experiments. 

Experiments  II  and  III: 

T  i  me 

Control  Stick  Commands  (Pitch  and  Roll) 


r 

Aircraft  Pitch  (Anqle  and  Rate) 

Aircraft  Roll  (Angle  and  Rate) 

Induced  Elevator  Disturbance 
Induced  Aileron  Disturbance 
Aircraft  Movement  (Real-tine  and  Cumulative) 

Experiment  IV 
T  ine 

X  and  Y  Coordinates  of  Aircraft 
A1 ti tude 

Down  Range  and  Cross  Range  From  Target  to  Aircraft  Position 

Slant  Ranqe  to  Target  From  Aircraft 

Velocity 

Aircraft  Roll,  Pitch  and  Dive  Anqlos 
Relative  Camera  Zoom  Position 

Cam  ra  Position  Anqles  With  Respect  to  the  Aircraft 
Frame ( Y aw  and  Pitch) 

In  Experiments  II  and  III  the  computer  generated  a  printout 
of  the  variables  mentioned  approximately  every  45  milliseconds 
of  each  run.  This  printout  began  two  seconds  prior  to  the 
induced  disturbance.  From  this  printout  the  following  per¬ 
formance  variables  were  nannually  extracted: 

Ai  rcraf t  Movement 


This  was  a  neasure  of  the  deqree  of  aircraft  movement  due 
to  the  subject's  use  of  the  control  stick.  To  calculate  this 
value  a  measure  was  first  used  of  the  deviation  from  straight 


and  level  fliqht  (zero  pitch  and  roll  anoles).  This  was 
obtained  by  calculatlnq  the  vector  lennth  of  the  pitch  and 
roll  anqles. 

dev  =  SQRT  (pitch2  +  roll2) 

This  value  was  calculated  durinq  every  connutation  cycle. 

The  mere  radical  the  pilot  was  controlling  the  aircraft  the 
faster  this  value  would  change.  The  final  aircraft  movement 
score  was  the  sum  of  the  differences  o^  these  values  from 
one  computer  cycle  to  the  next  multiplied  by  the  length  of 
that  cycle  (usually  40-50  milliseconds).  This  summation  be¬ 
gan  when  the  aircraft  anomaly  was  introduced  and  continued 
until  the  required  task  was  completed. 

Completion  Time 

This  was  the  amount  of  time  from  the  beginning  of  the 
anomaly  until  straiqht  and  level  fliqht  was  attained.  Straiqht 
and  level  flight  was  determined  by  the  deviation  value  (Equa¬ 
tion  1).  In  Experiment  II,  Phases  Two  and  Three,  the  toler¬ 
ance  was  0+2  degrees  for  three  seconds.  In  Experiment  II, 
Phase  Three  this  was  relaxed  to  0  +  3  deqrees  for  three  seconds. 
Experiment  III  utilized  both  a  deviation  value  of  0  +  2  deqrees 
and  required  the  attitude  rate  to  be  within  0+2  deq/sec. 
Response  Time 

This  was  the  elapsed  time  from  the  beginning  of  the  per¬ 
turbation  to  the  pilot's  first  response  to  the  perturbation. 

This  value  was  found  by  observing  a  time  history  of  the 
pilot's  control  stick  commands  as  they  related  to  the  onset 
of  the  perturbation. 
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T ine  to  Correct  Movement 

This  was  the  elapsed  time  from  the  beginning  of  the  per¬ 
turbation  until  the  subject  commanded  the  aircraft  toward 
straight  and  level  flight  in  both  pitch  and  roll.  This  value 
'/as  found  by  observing  the  first  responses  in  each  dimension 
(pitch  and  roll)  to  see  if  any  control  reversals  occurred. 

If  there  v/ere  no  reversals  the  time  to  correct  movement  and 
response  time  v/ere  the  same.  If  control  reversals  occurred, 
the  time  to  correct  movement  was  the  time  from  the  start  of 
the  perturbation  until  the  subject  recovered  from  any  control 
revers  a1 s . 

Control  Reversal 

Control  reversals  were  scored  by  reserving  the  first  re¬ 
sponse  in  both  pitch  and  roll  commands  and  notino  whether 
or  not  the  commands  were  correct  (in  other  v/ords,  tov/ard 
straight  and  level  aircraft  flight).  If  not,  a  pitch  and/or 
roll  reversal  v/as  noted,  flo  attempt  was  made  to  find  rever¬ 
sals  oth  r  than  those  due  to  the  onset  of  the  anomaly. 

For  Experiment  IV  a  printout  of  the  variables  was  pro¬ 
vided  every  250  milliseconds.  The  only  manual  analysis  re¬ 
quired  v/as  the  reduction  of  the  zoom  data.  The  other  data 
v/as  reduced  by  a  computer  program  that  generated  the  follow¬ 
ing  performance  variables: 

Altitude  mean  and  standard  deviation 

Heading  mean  and  standard  deviation 

Airspeed  mean  and  standard  deviation 
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Camera  pitch  angle  mean  and  standard  deviation 
Camera  yaw  angle  mean  and  standard  deviation 
Correlation  between  camera  pitch  and  yaw  motion 
Tine  of  target  recognition 

Slant  ranqe  to  tarqet  at  target  recognition  time 
Weapon  release  time 
Weapon  release  altitude 

Slant  range  to  target  at  weapon  release  tine 
Down  range  and  cross  range  of  weapon  impact 
X  and  Y  coordinates  of  weapon  Impact 
For  further  discussion  of  these  variables  see  Appendix  J. 


APPENDIX  E 


General  Description  of  Subjects  for  Experiments  II,  III  and  IV 

Two  squadrons  of  qualified  Navy  pilots  were  briefed  about 
the  general  research  program,  its  objectives  and  experimental 
procedures.  Volunteers  were  given  Form  A  of  Mitkin's  Embedded 

Figures  Test  (LFT)  (1971),  and  administered  a  demographic  question¬ 
naire.  Demographic  data  for  each  subject  group  is  discussed 
in  separate  appendices.  An  attempt  to  balance  low  and  high 
EFT  scores  and  pilot  experience  levels  (low  and  high)  was 
abandoned  as  a  result  of  working  within  the  pilots  flight 
operations  schedules  and  availability  of  the  computer. 

Homogeneity  of  qualified  Navy  pilot  sub-group  was  attempted 
through  a  rigorous  pre-selection  process.  This  qualifying 
factor  was  intended  to  reduce  overall  costs  and  the  control 
problems  experienced  when  dealing  with  a  multitude  of  experi¬ 
mental  variables.  Subjects  from  NAS  Miramar  were  identified 
through  the  cooperation  of  the  ONR  Office  in  Pasadena,  Cali¬ 
fornia.  These  individuals  served  not  only  as  subjects  but 
also  as  contributing  exper imentors .  Willingress  to  volunteer 
and  availability  to  participate  in  this  project  were  impor¬ 
tant  selection  criteria.  Twenty  individuals  were  utilized 
to  fulfill  the  entire  experimenta1  requirements  throughout 
the  full  series  of  tests.  Sub-groups  of  four  persons  each 
usually  comprised  an  experimental  cluster  in  a  balanced 


run  order. 


Prior  to  initiation  of  data  collection  procedures,  each 
subject  was  thoroughly  oriefed.  This  briefing  covered  the 
subject's  role  in  the  experlnent,  specific  task  requirements, 
use  of  controls  and  displays,  and  experimental  procedures. 
Pre-  and  post-experiment  questionnaires  were  administered  to 
subjects . 

tach  subject  sat  in  a  ground-based  cockpit  configured 
much  like  conventional  aircraft  modified  for  this  RPV  ex¬ 
periment. 


APPENDIX  F 

experiment  II 

Details  of  Subjects,  Data  Reduction  Method¬ 
ology,  Experimental  Design  and  Experimental 
Procedures 


Subjects 

Six  Navy  pilots  volunteered  to  participate  as  subject- 
experlmentors  In  the  first  two  phase  tests.  The  average  age 
was  27  years  with  4.3  years  of  Navy  service  and  an  average  of 
7.2  years  piloting  experience.  All  were  college  educated, 
fighter  pilots  having  sone  simulator  experience  and  some  know¬ 
ledge  of  research  methods.  All  were  in  excellent  physical  con 
dition  and  had  20/20  vision  uncorrected.  The  averane  EFT 
score  was  12.3  seconds.  When  questioned,  none  had  reported 

experiencing  nor  were  familiar  with  the  phenomena  of  control 
reversal s . 

Four  Navy  pilots  participated  in  the  third  phase  of  this 
experiment.  Average  age  was  31  years  with  9.7  years  of  Navy 
service  and  an  average  of  9.3  years  of  pilot  experience.  Sun- 

naries  of  demographic  factors  for  ten  subjects  may  be  found  in 
Table  2. 

Experimental  Procedure 

The  experimental  procedure  for  the  three  phases  of  experi¬ 
ment  II  was  the  same.  Each  run  (unique  independent  variables 
configuration)  consisted  of  six  repetitions.  At  the  start  of 
each  repetition  the  subject  took  control  of  the  aircraft  at  an 
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Yrs.  in  Yrs.  in  Yrs. Pilot  Military  Civilian  Combat  Combat  EFT 
Subj.  Age  Navy  College  Exp.  Fly.  Hrs.Flv.  Itrs.  Fly.Hrs.  Mission  Scor 


DEMOGRAPHIC  DATA  SUMMARY 
Display  Incompatibility 


altitude  of  6,000  feet  and  an  airspeed  of  300  knots.  The  sub¬ 
ject  then  changed  altitude  as  instructed  (within  +  1,000  foot 
channe).  After  the  subject  attained  the  proper  altitude  the 
test  conductor  introduced  an  attitude  perturbation  in  pitch 
and  roll.  The  direction  and  size  of  this  perturbation  was 
preset  by  the  test  conductor  prior  to  each  repetition  accord¬ 
ing  to  a  preplanned  order  which  was  the  sane  for  all  subjects, 
but  different  for  each  run.  The  subject  was  instructed  to  re¬ 
cover  from  this  perturbation  by  returning  to  straight  and  level 
flight.  Straight  and  level  flinht  was  defined  by  preset  com¬ 
puter  tolerances. 

Experimental  Design 

Experiment  II  was  conducted  in  three  separate  phases.  Each 
phase  had  somewhat  different  independent  variable  sets.  In 

spite  of  this  the  experimental  design  for  all  phases  was  quite 
similar. 

Phase  One 

The  experimental  design  for  phase  one  was  originally  a 
3x2x2  factorial  design  with  balanced  run  orders  for  the 
two  subjects.  Each  subject  experienced  all  combinations  of 
the  three  variables  with  six  repetitions  on  each  combination. 
These  variables  were: 

1.  Sensor  mounting  mode  three  levels  (fixed,  smoothed, 
and  stabilized). 

2.  Attitude  direction  indicator  (ADI)  two  levels  (visi¬ 
ble  and  covered ) . 


96 


3.  Video  heads-up  attitude  display  -  two  levels 


(visible  and  not  visible). 

This  design  was  reduced  to  a  3  x  3  factorial  after  it  be- 
cane  obvious  that  the  subjects  could  not  perform  the  task  or 
performed  poorly  when  no  attitude  information  was  available. 
The  new  design  used  the  same  sensor  mounting  variable  but 
combined  the  attitude  displays  in  one  variable  with  three 
levels  (ADI  only,  heads-up  attitude  display  only,  and  both 
ADI  and  heads-up  display). 

In  this  phase  the  heads-up  attitude  display  was  a  gen¬ 
erated  aircraft  symbol  on  the  video  monitor.  This  symbol 
responded  in  an  inside-out  mode.  This  was  a  pluqboard  error. 
It  was  one  of  the  considerations  that  led  to  phase  two. 

Phase  Two 

The  experimental  design  for  phase  two  v.'as  a  3  x  3  x  2 
factorial  design  with  balanced  run  order.  The  independent 
variables  were  the  sensor  mounting  mode,  variable  (three 
levels),  the  attitude  display  variable  (thme  levels),  and 
the  perturbation  time  (two  levels).  The  first  two  variables 
were  the  sane  as  in  phase  one,  except  that  the  aircraft  sym¬ 
bol  responded  correctly.  The  two  perturbation  times  were 
slow  (approximately  one  second)  and  fast  (approximately  180 
milliseconds).  Each  of  the  four  subjects  experienced  all 
combinations  of  the  first  two  variables  with  six  repetitions 
on  each  combination.  The  perturbation  time  was  held  constant 
for  each  subject  with  two  subjects  experiencing  the  fast  time 
and  two  subjects  experiencing  the  slow  time. 
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Phase  Three 


The  experimental  desiqn  for  this  phase  was  a  "  x  ?  fac¬ 
torial  design  with  balanced  run  order.  The  two  independent 
variables  were  the  video  heads-up  attitude  display  mode  (arti¬ 
ficial  horizon  and  aircraft  symbol)  and  the  sensor  mounting 
mode  (fixed  and  stabilized).  Each  of  four  subjects  was  ex¬ 
posed  to  all  four  combinations  of  these  two  factors  with  six 
repetitions  on  each  combination.  After  the  first  four  runs 
each  subject  had  two  more  runs  using  the  two  sensor  mounting 
modes  with  the  aircraft  symbol  attitude  displav.  These  two 
extra  runs  were  introduced  to  try  to  identify  any  possible 
learning  present  in  the  use  of  the  aircraft  symbol  display. 

The  main  reason  for  trying  to  find  learning  on  this  display 
was  that  the  pilot/subjects  were  experienced  in  responding 
to  an  inside-out  display  (artificial  horizon)  but  not  to  an 
outside-in  display  (aircraft  symbol). 

Mpthods  for  Data  Reduction  and  Analysis. 

Fliqht  parameters  were  continuously  recorded  durinq  the 
experiment  to  enable  evaluation  and  consideration  of  per¬ 
formance  measures  at  leisure.  A  data  reduction  program  was 
written  that  calculated  the  time  to  recovery  and  total  air¬ 
craft  movement.  A  printout  of  the  significant  fliqht  para¬ 
meters  (time,  pitch  and  roll  commands,  pitch  and  roll  command 
rates,  pitch  and  roll,  pUch  and  roll  rates,  indicators  of 
when  the  perturbation  began,  measure  of  aircraft  movement  and 
integration  of  aircraft  movement  measure)  was  generated  for 


the  tine  frane  surrounding  the  ne rturbati on .  This  printout 
was  reviewed  to  find  the  time  :»nd  direction  of  the  initial 
pilot  respons0  to  the  perturbation  and  also  to  discover  any 
possible  con  r-cl  reversals  In  this  response.  This  portion 
of  the  analyses  process  was  not  automated  due  to  the  lack  of 
an  algorithm  sufficient  to  locate  these  values.  The 
pilot  was  often  maneuvering  the  aircraft  at  the  tine  of  the 
perturbation,  therefore  the  pattern  of  the  pitch  and  roll 
connands  prior  to  and  during  the  perturbation  had  to  be  manu¬ 
ally  reviewed  to  pinpoint  exactly  when  the  pilot  actually 
responded  to  the  perturbation.  It  is  well-known  that  writing 
a  computer  algorithm  to  analyze  such  complex  patterns  is  not 
a  simple  or  straightforward  task. 

The  data  analysis  was  performed  through  use  of  a  General 
Linear  Model.  This  method  is  being  used  in  lieu  of  the  Fac¬ 
torial  Model  due  to  unequal  numbers  of  observations  in  the 
design.  Unequal  observations  were  a  result  of  data  lost  in 
the  process  of  recording  on  magnetic  tape. 

Three  display  configurations  were  not  analyzed.  They 
were  the  fixed,  smoothed,  and  stabilized  TV  nodes  with  no 
attitude  display.  These  combinations  were  so  difficult  to 
fly  that  the  pilots  were  not  able  to  complete  the  task,  or 
performed  very  poorly,  so  that  the  specific  data  collected 
was  essentially  useless.  The  reason  for  this  difficulty  cen¬ 
tered  upon  the  roll  attitude  display.  In  these  nodes  air- 
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craft  attitude  was  not  di:olayed.  The  only  available  feed- 
tack  was  altitude,  rate  of  cllnb,  and  the  TV  camera.  With 
he  stabilized  camera  the  pilot  received  no  roll  attitude 
feedback.  With  the  smoothed  camera  the  roll  attitude  was 
delayed  enough  to  confuse  most  pilots.  With  the  fixed  camera 
roll  feedback  was  sufficient  for  most  pilots,  however,  over¬ 
all  performance  was  sufiiciently  degraded  as  a  result  of  the 
grossness  of  this  feedback. 
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APPENDIX  G 
EXPERIMENT  II  RESULTS 

The  results  of  '.he  experimenta  1  phases  are  shown  in 
Tab’es  3  through  7.  It  is  emphasized  that  no  data  were  ana¬ 
lyzed  which  resulted  from  runs  where  the  subjects  had  no 
attitude  feedback  other  than  the  TV  picture.  The  results  of 
these  conditions  were  so  erratic  that  analysis  would  have 
been  misleading  if  not  impossible  to  inteoret.  In  the  tables, 

"A"  refers  to  the  attitude  display  modes;  "T"  refers  to  the  sen¬ 
sor  modes, and  "P"  refers  to  perturbation  tines,  when  it  was 
,.n  independent  variable. 

The  results  include  six  repetition!  for  each  subject  on 
each  display  mode.  Ten  subjects  were  used.  Two  on  Phase  1, 
four  on  Phase  2  (two  with  long  perturbation  tines  and  two 
with  short  perturbation  tines)  and  four  on  Phase  3.  Nine  runs 
(six  repetitions  each)  were  analyzed  for  Phases  1  and  2  for 
each  subject  (three  sensor  modes  times  three  attitude  display 
modes).  Six  runs  were  analyzed  for  Phase  3.  Four  runs  were 
conducted  for  combinations  of  the  two  attitude  nodes  tines 
the  two  camera  modes  plus  two  runs  repeating  the  aircraft  sym¬ 
bol  attitude  mode  with  the  two  camera  modes.  Repetition  of 
these  two  combinations  explored  learning  during  aircraft 
symbol  attitude  mode.  The  first  six  pilots  were  observed  to 
have  some  difficulty  adjusting  to  that  particular  display  as 
far  as  pitch  control  reversals  were  concerned. 

In  Tables  3,  5,  and  7,  the  general  factors  are  noted  in¬ 
cluding  E-statistic,  degrees-of-f reedom  and  significance 


101 


level  (if  greater  than  .90)  with  respect  to  each  continuous 
variable.  The  contingency  tables  along  with  the  chi-squared 
statistic  and  deg  roes -of  -  freedom  are  reported  for  pitch,  roll 
and  total  control  reversals  with  respect  to  each  factor.  The 
results  of  testing  for  <iqnificant  correlation  with  run  order 
and  repetition  order  (co-variates)  are  also  reported.  These 
two  variables  were  statistically  controlled  throughout  the 
analysis.  When  significant  interaction  occurred  the  signi¬ 
ficance  of  the  main  effects  is  designated  by  an  asterisk  in¬ 
dicating  that  caution  should  be  exercised.  The  interaction 
results  are  reported  in  Tables  4  and  6 . 

INTERPRETATION  OF  TABLES 

The  interpretation  of  these  tables  is  best  explained  by 
using  an  example.  It  nay  be  noted  in  the  body  of  Table  3, 
under  aircraft  movement,  there  is  an  F-statistic  of  3.375 
for  the  attitude  factor,  A,  with  G  and  97  degrees -of- free¬ 
dom.  This  F-statistic  is  a  measure  of  how  much  normalized 
variation  (normalized  meaning  consistent  departures  from  the 
average  value  under  the  different  conditions,  and  not  accounted 
for  by  normal  variation  within  a  given  condition)  has  occurred 
between  the  different  crmponents  of  this  factor  (aircraft 
symbol,  ADI,  and  both).  The  smaller  the  F-statistic  the  more 
homogeneous  the  aircraft  movement  noted  between  the  components, 

t|ie  lar<?er  the  F-statistic  the  larger  the  effect  of  these  com¬ 
ponents  on  aircraft  movement. 


102 


The  cJegrees-of-f reedom  determine  which  F-statistic  values 
a  re  significant.  The  degrees-of-freedon  compensate  ror  diff¬ 
erences  in  sample  size  and  the  numbers  of  levels  and  factors. 

ip  significance  of  the  F-statistic  (.99  in  our  example)  im¬ 
plies  that  if  these  three  levels  (i.e.,  three  attitude  dis¬ 
play  nodes)  had  no  real  effect  on  this  variable  (aircraft 
movement)  then  99*  of  the  time  aircraft  movement  scores  gen¬ 
erating  a  smaller  F-statistic  would  be  expected. 

The  conclusion  is  that  this  F-statistic  did  not  result 
from  that  }%  random  occurrence  but  was  due  to  a  real  differ¬ 
ence  in  the  effect  of  these  levels  on  those  subject’s  per¬ 
formance  with  respect  to  aircraft  movement.  The  direction 
of  these  differences  is  found  by  looking  at  the  actual  aver¬ 
age  values  associated  with  these  conditions.  In  this  case 
the  averages  are: 

A0  =  2.679  deg . sec . 

A.  =  1.945  deg. sec. 

A 2  =  1.956  deg . sec . 

As  can  be  seen  the  A1  and  A2  averages  are  virtually  the  same 

whereas  the  Aq  average  is  considerably  larger.  The  size  of 
this  difference  is  deemed  significant  by  using  a  Multiple 
Range  Test  (Duncan's  Multiple  Range  Test  in  this  case).  It  indi¬ 
cates  which  averages  are  significantly  different.  This  is 
done  by  looking  at  the  pooled  standard  deviation  (sort  of  an 
average  of  the  standard  deviations  under  each  condition)  and 
discerning  if  the  difference  between  jpecific  averages  is 
larger  than  would  be  expected  by  chance. 
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TABLE  3  . ( page  1  of  2 ) 


Interaction  detailed  results  reported  in  table 
A0  significantly  greater  than  A,  and  A0. 


TABLE  4 

Detailed  Results  of  Experiment  1 1  -  Phase  1 
Time  to  Respond 

Average  tl.es  (seconds)  under  the  various  combinations  of 
TV  camera  modes  and  attitude  display  modes. 


•  5892 

.532 

.5261 

.63253 

■ 

.5822 

.  6  3  3  3 

.66834 

,7«55 

.  5321 

Averages  with  the  same  subscrint 

suDscript  are  not  significantly  diff 

e*-ent  (.95  level  -  Duncanfs  Multiple  Range  Test) 


Group  Mode  Combinations 


Attitude  D1 


Table  5  conti nued 


CONTROL  REVERSAL  RESULTS 
(P  has  no  effect) 

2 

Frequency  Tables  X  Statistic  -  2  d . f . -Si gni f i cance 


Total 


Reversals 

A0 

A1 

A2 

1 

36 

14  j 

r - - 

8 

To 

Ti 

T2 

16 

21 

21 

Pitch 
Reversal s 

Ao 

Ai 

A2 

8 

4 

6 

To 

Ti 

T2 

1  3 

7  1  8 

_ 1 _ 

Roll 

Reversal  s 

Ao 

Ai 

A2 

28 

10 

2 

To  T1  T2 

13 

14 

13 

(1)Aq  significantly  more  reversals. 


22. 51 


.86 


1.33 


2.33 


26. 61 


.05 


.999 


N.S. 


N.S. 

N.S. 


.999 


N.S. 


108 


Detailed  Results  of  Experine 
Time  to  Correct  Mover 
Average  times  (seconds)  under  various  co 
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Table  7 

Results  of  Experiment  II  Phase  3  -  Continuous  Variables 
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DISCUSSION  OF  RESULTS 

Phase  1 

Phase  1  consisted  of  three  attitude  displays  (inside- 
out  aircraft  symbol,  ADI,  and  both  ADI  and  inside-out  air¬ 
craft  symbol)  and  three  sensor  mounting  modes  (fixed,  smoothed 
and  stabilized).  The  camera  downlook  angle  was  fixed  at  15° 
and  the  perturbation  speed  was  fixed  at  one  second.  Tables  3 
and  4  indicate  the  results  of  the  analysis. 

Significant  interaction  with  resnect  to  response  time  is 
detailed  in  Table  4.  it  may  be  noted  that,  in  general, 
higher  values  (poorer  results)  were  noted  with  T2  (stabilized 
mode)  and  lower  values  with  Tq  (fixed  node)  indicating  that 
the  lack  of  or  delay  in  TV  picture  movement  (stabilized  or 
smoothed,  respectively)  contributed  to  longer  response  tines. 
This  outcome,  however,  was  not  consistently  true.  Other 
interpretations  of  the  interaction  values  are  not  immediately 
obvious.  It  should  be  noted  that  no  significant  effects  were 
noted  with  this  variable  during  Phase  2  of  this  experiment. 

The  aircraft  symbol  that  responded  in  an  inside-out  man¬ 
ner  contributed  significantly  to  lonqer  completion  times 
and  more  aircraft  movement.  It  may  be  that  relative  unfami¬ 
liarity  with  a  heads-up  display  as  opposed  to  the  conventional 
ADI  could  have  contributed  to  these  results.  Some  improve¬ 
ment  with  experience  was  noted  with  respect  to  aircraft  move¬ 
ment  scores.  The  aircraft  symbol  also  contributed  to  a 
greater  total  number  of  control  reversals  along  with  more 


roll  reversals.  Display  unfamiliar! ty  again  may  be  a  possi 
ble  reason  for  this  outcome. 


Phase  2 

Phase  2  contrasted  three  attitude  displays  (outside-in 
aircraft  symbol,  AO  I ,  and  both  outside-in  aircraft  symbol  and 
AIM),  three  sensor  mounting  modes  (fixed,  smoothed,  and 
stabilized)  and  two  perturbation  times  (slow,  one  second; 
fast,  f 80  milliseconds).  Camera  downlook  angle  was  7.5°. 
Tables  5  and  6  indicate  the  numerical  results  of  the  analysis. 

Ho  significant  results  were  noted  with  respect  to  re¬ 
sponse  time,  an  outcome  differing  from  Phase  1. 

Tine  to  correct  movement  was  affected  by  all  variables 
(i.e.,  interaction  was  significant).  Some  improvement  was 
noted  with  increased  experience.  Generally  better  perform¬ 
ance  was  demonstrated  in  the  experiment  with  the  Am  than 
with  the  aircraft  symbol.  TV  modes  and  perturbation  times 
nad  an  effect  on  the  correct  movement  times,  however,  this 
effect  was  not  consistent  nor  readily  i nterp re  tab  1 e  . 

Completion  tines  were  significantly  longer  with  the  air¬ 
craft  symbol  only.  Unf ami  1 i ari 1 ty  and  confusing  background 
probably  explain  this  result.  Perturbation  duration  times 
also  contributed  to  significantly  different  completion  tines. 
Completion  times  with  the  short  perturbation  were  longer 
than  with  the  l_ong  perturbation.  The  effects  of  the  pertur- 
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batlon  could  be  a  result  of  the  sudden  onset  of  the  pertur¬ 
bation  eliciting  a  surprise  reaction  from  which  the  subject 
takes  longer  to  recover. 

Significant  Interaction  was  noted  with  respect  to  aircraft 
movement.  Aircraft  movement  here  is  an  inverse  measure  of 
consistency  of  control.  In  general,  both  the  short  pertur¬ 
bation  and  aircraft  symbol  contributed  to  more  aircraft  move¬ 
ment.  There  was  a  tendency  for  increase  in  background  motion 
to  improve  aircraft  control ab i 1 i ty  (decrease  the  aircraft 
movement  score).  These  results  agree  partially  with  the  re¬ 
sults  for  completion  time.  The  sensor  mounting  mode  effects 
could  indicate  that  the  subject  was  confused,  when  there  was 
not  a  one-to-one  relationship  between  the  heads-up  attitude 
display  and  the  video  picture. 

The  aircraft  symbol  contributed  to  significantly  more 
total  control  reversals  and  more  roll  reversals.  The  most 
obvious  reason  for  this  was  subject  familiarity  with  the  ADI 
type  instrument. 

Phase  3 

Phase  3  consisted  of  two  heads-up  attitude  displays  (out¬ 
side-in  aircraft  symbol  and  inside-out  artificial  horizon) 
and  two  sensor  mounting  modes  (fixed  and  stabilized)  the 
camera  downlook  angle  was  7.5°.  The  perturbation  time  was 
180  milliseconds.  Numerical  results  of  analysis  are  shown 
in  Table  7. 
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Some  interaction  was  noted  with  respect  to  tine  to  re¬ 
spond.  When  both  the  heads-up  attitude  display  and  the 
sensor  mounting  were  in  the  sane  type  node  [in  other  words, 
inside-out  (artificial  horizon  and  fixed)  or  outside-in 
(aircraft  symbol  and  stabilized)]  reaction  tine  was  decreased 
over  conflicting  nodes. 

The  artificial  horizon  contributed  to  significantly 
better  tines  to  correct  novenent.  This  was  mainly  due  to 
the  less  drastic  pitch  control  reversals  with  this  node. 

Significant  learning  was  noted  with  respect  to  conplPtion 
tines  ( i .e. .completion  tine  decreased  with  experience  on  the 
simulator).  Sone  learning  was  noted  with  respect  to  aircraft 
movement  scores  so  that  aircraft  movement  scores  decreased 
as  experience  on  the  simulator  increased. 

!lo  significant  differences  were  noted  in  the  total  number 
of  control  reversals,  but  tfiere  were  significantly  more  pitch 
reversals  with  the  artificial  horizon  and  more  roll  reversals 
with  the  aircraft  symbol.  There  was  no  apoarent  decrease  or 
increase  in  control  reversals  (pitch,  roll,  or  total)  as  ex¬ 
perience  with  the  aircraft  symbol  increased. 


APPENDIX  M 

Details  of  Experiment  III  Subjects,  Methodology, 
and  Desipn 

Two  pilot-subjects,  average  age  27.5  years  (See  Table  8 
for  subject  data),  were  exposed  to  36  trials  (6  repetitions 
for  6  conbi nati ons )  each  in  a  balanced  run  order  2x3  fac¬ 
torial  desiqn.  The  subjects  were  launched  at  1000  feet  and 
instructed  to  fly  the  aircraft  to  500  foot  altitude,  main¬ 
taining  this  altitude  and  an  airspeed  just  above  136  knots. 
Subjects  were  also  instructed  to  look  for  ground  tarqets. 
Altitude  and  airspeed  performance  were  not  scored  in  this 
experiment  since  the  particular  controls  in  use  would  main¬ 
tain  fairly  consistent  flight  profiles  across  subjects.  Once 
a  stable  flight  condition  had  been  readied  an  attitude  per¬ 
turbation  (180  milliseconds)  disturbina  pilot  control  was 
introduced  to  the  aircraft.  The  subject's  task  was  to  re¬ 
cover  control  and  stabilize  the  craft  while  maintaining  alti¬ 
tude,  direction,  and  speed  parameters.  The  study  compared 
performance  variables  for  three  heads-up  displays  each  under 
two  different  camera  mounting  modes.  Dependent  variables 
for  performance  measurement  were  the  same  as  for  experiment 
two.  Independent  variables  were  sensor  mounting  (same  as 
experiment  two,  phase  three,  fixed  and  stabilized)  and  heads- 
up  attitude  display.  Three  heads-up  attitude  displays  were 
presented  to  subjects.  They  were:  aircraft  symbol  (outside- 
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In),  artificial  horizon  (inside-out)  and  combination.  Here 

the  combination  display  Is  the  same  as  referenced  earlier 

wherein  the  artificial  horizon  moves  in  roll  only  and  the  air 

craft  symbol  moves  in  pitch  only. 

In  effect,  experiment  III  was  different  from  experirent 

II,  phase  three  in  tv/o  w ays.  The  aircraft  was  launched  and 

flown  at  much  lower  altitudes.  A  n ew  heads-up  attitude  dir- 

play  was  generated  and  compared  to  the  tv/o  previously  used 

displays . 


APPENDIX  I 
Expcr inen t  III 


Results 

The  results  of  the  experiment  revealed  that  the 
combination  display  decreased  total  control  reversals  (See 
Table  9  ). 

There  was  a  significant  increase  of  roll  reversals 
with  the  aircraft  symbol.  The  inside-out  presentations  of 
roll  attitude,  artificial  horizon,  and  combination  display 
v/ere  superior. 

For  overall  tine-to-respond,  significant  differences 
in  performance  were  obtained.  The  aircraft  symbol  resulted  in 
improved  performance  (p>  .995).  (See  Table  10  for  results.) 

Significant  learning  (p>  .95)  was  demonstrated  in 
the  subject's  ability  to  control  the  aircraft.  Aircraft 
movement  scores  were  also  significantly  improved  within  runs 
yielding  evidence  of  significantly  increased  performance 
with  a  particular  display.  For  performance  with  respect  to 
efficiency  of  control  (aircraft  movement)  further  signifi¬ 
cant  results  weie  obtained.  At  the  .95  level  the  artificial 
horizon  attitude  display  was  shown  to  be  significantly  less 
desirable  than  the  other  attitude  indicators.  At  the  same 
time  a  fixed  camera  yielded  the  best  performance  (p  ->.90) 
when  compared  to  the  stabilized  mode. 


TABLE  -9 

Control  Reversals 
Results 


Frequency  Tables 
Total  Reversals 

A0  A,  C* 

19  13  5 

(T0)Fixed  (T]  )  Stab.** 

13  15 

Pitch  Reversals 

A0  A,  C 

0  4  4 

Fixed  Stab. 

0  8 


Roll  Reversals 

A0  A-,  C 

4  9  1 

TQ(Fixed)  T] (Stab) 

7  7 

A 1 1 i tude  Di spl ays 

Aq  =  Artificial  Horizon 
A^  =  Aircraft  Symbol 
C  =  Combination 


2 

X  -Statistic  Significance 

(2  d.f.) 


3.6 


NS (.05) 


.14 


fl.S. 


.57 


N.S. 


.29 


fl.S. 


7.0 


.95 


0.0  N.S. 

**  Camera  Modes 

Fixed  =  Fixed  to  Airframe 

Stab  =  Stabilized  in  pitch 
and  roll. 


RESULTS  EXPERIMENT  III  Continuous  Variables 
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APPENDIX  J 


Experiment  IV 

Total  Strike  Mission  Experiment 
Details  of  Subjects,  Methodology,  and  Experimental  Desiqn 

Subjects 

Eight  qualified  Naval  pilots  participated  as  subject- 
experi mentors  as  volunteers.  Average  age  was  31  years  with 
an  average  of  7.6  years  as  pilots.  Refer  to  Table  11  for 
demoq^aphic  data.  The  subjects  averaged  nine  years  of 
Naval  experience.  They  indicated  considerable  experience 
with  the  typical  tasks  required  of  them.  Considerable  demo¬ 
graphic  data  and  commentary  concerning  the  experiment  were 
collected,  however,  not  reduced.  These  data  were  not  con¬ 
sidered  vital  to  the  purpose  at  hand,  and  were  used  only 
when  special  attention  to  a  particular  performance  was  re- 
qu 1  red. 

Experimental  Design 

A  3  x  2  x  2  factorial  design  with  balanced  run  order 
was  used  for  this  experiment.  There  were  four  repetitions 
within  each  run  for  each  subject.  The  three  independent 
variables  were  the  task,  attitude  display/camera  mode,  and 
zoom.  A  brief  description  of  each  follows. 

Task :  Three  tasks  were  presented  to  the  subjects.  The 
original  experiment  had  called  for  contrasting  slew 
and  no  slew  of  the  TV  camera.  There  was  also  an  in¬ 
terest  in  contrasting  the  use  of  "smart"  and  "dumb" 
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Demoqraphic  Data  Summary 
Experiment  IV 
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v/eapons.  This  was  to  be  done  by  assuminn  the  "smart" 
weapons  could  go  to  the  point  on  the  ground  at  which 
the  camera  was  looking  at  release  tine.  The  "dunb" 
weapons  would  continue  on  the  flight  path  of  the  air¬ 
craft  after  release.  A  preliminary  inspection  of  these 
two  factors  showed  that  they  were  inter-related  in  that 
the  "smart"  weapon  with  no  camera  slew  was  like  the 
"dumb"  weapon  without  camera  slew  as  the  aircraft  and 
camera  were  always  pointing  in  the  same  direction  ex¬ 
cept  for  a  downlook  bias.  Therefore,  the  subjects  were 
told  to  perform  three  tasks. 

The  first  task  involved  no  slew  and  the  subject 
was  required  to  fly  the  aircraft  so  that  the  reticle  was 
on  the  target.  Under  this  task  the  reticle  displayed 
the  position  at  which  the  aircraft  nose  was  pointlnq. 
Engineering  tests  on  this  task  demonstrated  the  need  for 
different  sensor  angles  for  the  two  mounting  modes.  It 
was  noted  that  a  -7.5°  angle  with  the  fixed  mode  created 
an  unrealistic  bias  on  the  position  of  the  bulls-eye 
(near  the  top  of  the  screen)  whereas  a  0°  downlook  put 
the  bulls-eye  in  the  center  of  the  screen  wich  was  much 
easier  for  sighting,  particularly  in  a  dive.  The  0° 
downlook  for  the  stabilized  mode  was  unrealistic  due  to 
the  fact  that  very  little  of  the  terrain  could  be  seen. 
Minus  7.'J°  was  chosen  because  a  larger  angle  forced  the 
bulls-eye  ( i . e . ,  indicator  of  aircraft  nose)  off  the 


screen  in  a  shallow  dive.  In  the  other  two  tasks  the 
angle  could  be  adjusted  by  the  subjects  through  use  of 
slew  control.  The  first  task  was  comparable  to  having 
either  a  "dumb"  or  a  "smart"  weapon  without  slew.  The 
second  task  was  similar  to  having  a  "dunb"  weapon  with 
slew  control  available  for  target  search.  In  this  task 
the  bulls-eye  again  indicated  the  aircraft  nose  pointing 
angle  with  respect  to  the  sensor.  The  third  task  simu¬ 
lated  a  "smart"  weapon  that  would,  upon  release,  fly  to 
the  ground  point  at  which  the  sensor  was  directed.  In 
this  task  the  bulls-eye  remained  fixed  at  the  center  of 
the  screen  as  it  indicated  where  the  camera  was  point¬ 
ing.  The  subject  could  accomplish  this  task  by  flying 
the  aircraft  to  the  target  or  by  flying  the  aircraft  in 
the  vicinity  of  the  target  then  using  the  slew  controls 
to  center  the  sensor  on  the  target  and  then  release  the 
weapon . 

All  three  tasks  involved  putting  the  gunsight  reticle 
on  the  target  at  weapon  release.  Both  body-fixed  and 
sensor-fixed  gunsights  were  simulated.  The  body-fixed 
sight  would  typically  be  required  for  "dumb"  weapons  such 
as  unguided  bombs,  rockets,  guns,  etc.  The  sensor-fixed 
sight  would  typically  be  associated  with  "smart"  weapons 
such  as  television  or  infrared  guided  bombs,  guided  rockets, 
etc.  The  sensor-fixed  sight  remained  stationary  on  the 
video  monitor  at  all  times,  while  the  body-fixed  sight  moved 
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in  compensation  for  sensor  motions  with  respect  to  the 
airframe.  For  example,  if  the  sensor  was  depressed 
five  degrees,  the  sight  rose  five  degrees  on  the  monitor. 
This  motion  could  be  in  response  to  pilot  slewing  commands 
or  sensor  stabilization  commands. 

Figure  1 2 A  shows  the  video  image  the  pilot  sees  as  he 
approaches  the  target.  The  target  is  represented  by  the 
black  square  with  the  white  center  spot.  Figures  123  and 
1 2 C  show  the  "outs i de- i n "  aircraft  symbol  in  conjunction 
with  the  gunsight.  The  aircraft  symbol  is  depressed  from 
the  center  of  the  screen  due  to  a  30°  pitch  down  attitude. 
The  symbol  is  rolled  ten  degrees  to  represent  a  ten  degree 
right  bank . 

In  Figure  1 2B  the  reticle  is  shown  as  aligned  with 
the  aircraft  nose.  Consequently,  since  the  camera  is 
nominally  biased  down  the  reticle  appears  7.5  degrees 
above  the  horizon  on  the  video  monitor  since  it  indicates 
the  relative  anqle  between  the  camera  and  the  RPV's  nose. 
In  the  vehicle  fixed  qunsight  mode,  the  symbol  moves  in 
response  to  the  subject's  sensor  control  motions  or 
stabilization  commands.  The  symbol  always  represents  the 
orientation  of  the  vehicle  relative  to  the  camera.  The 
gunsiqht  in  Fiqure  1 2 C  is  aliqned  with  the  camera  and 
consequently  remains  centered  even  durinq  camera  slewing. 
This  type  of  qunsight  is  more  typical  of  "smart"  wea¬ 
pons  that  only  need  to  be  "shown"  the  target.  Figure  12D 
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illustrates  the  artificial  horizon  or  “inside-out"  sym¬ 
bol.  Notice  that  in  comparison  with  the  aircraft  symbol 
Of  Figure  12C  it  is  located  high  on  the  screen  to  indicate 
a  30  dive  and  that  the  10"  right  wing  down  results  in 
a  horizon  which  is  right  side  high.  Figure  12E  illustrates 
the  composite  symbol.  The  horizon  is  retained  for  roll 
indication  and  pivots  about  the  center  of  the  screen. 

an  craft  symbol  always  appears  wing  level  but  other¬ 
wise  shows  pitch  attitude.  The  two  different  gunsight 
modes  are  available  with  any  of  three  attitude  symbols. 

Attltu.de.  Dij^Ux  Sensor  Mounting  Mode:  In  the  previous 
experiments  results  demonstrated  certain  conclusions  about 
compatability  of  displays.  In  particular,  the  results 
showed  that  efficient  flight  control  is  improved  with  a 
fixed  sensor  mode  and  the  combination  attitude  display. 

Also,  it  was  noted  that  if  a  stabilized  sensor  was  needed 
that  the  aircraft  symbol  was  the  better  attitude  display. 

In  this  experiment  a  contrast  was  desired  between  the 
fixed  and  stabilized  modes  for  target  acquisition  and 
attack.  The  previous  results  dictated  the  attitude  dis¬ 
plays  used.  Sensor  angles  of  0.0"  for  the  fixed  node  and 
-7.b°  for  the  stabilized  mode  were  used.  The  reasons  for 
this  are  explained  in  the  previous  section. 


A i rc  r a  f  t  Symbo 1 
with  " sma r t "  weapon 


Aircraft 


12E  Combination  Display 
wi  th  "smart"  weapon 


Artificial  hot: 
with  "smart" 
weapon 


Examples  of  Video 
Picture  and 
Different  Heads-Up 
Attitude  Displays 


Video  i i c  t  u  r 


Zoom:  This  factor  had  two  levels  which  were  the 


presence  or  absence  of  a  zoom  capability  on  the 
camera.  No  specific  requirements  were  qiven  to 
force  the  use  of  zoom  when  available. 

Dependent  Variables 

For  scoring  purposes  the  mission  was  separated  into  three 
phases . 

Phase  One  -  Enroute: 

This  started  ten  seconds  after  launch  and  continued  until 
twenty-five  seconds  after  launch.  During  this  phase  the 
subjects  were  scored  on  maintenance  of  altitude,  velocity, 
and  heading.  The  scores  recorded  were  the  mean  and  the  stand¬ 
ard  deviation  of  atti tude  in  feet,  he adi ng  in  degrees  and 
vel oci ty  in  feet  per  second  (fps). 

Phase  Two  -  Target  Search:  This  phase  started  twenty- 
five  seconds  after  launch  and  lasted  until  the  target  recog¬ 
nition  button  was  pressed.  The  variables  recorded  here  were 
the  tine  at  target  recognition  and  the  slant  range  from  air¬ 
craft  to  target  at  tarqet  recognition.  During  this  period  a 
recording  of  the  use  of  slew  was  made.  The  means  and  standard 
deviation  of  the  camera  pitch  and  yaw  angle  movements  were 
calculated  along  with  the  correlation  between  sensor  pitch  and 
yaw  control . 
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Phase  Three  -  Attack:  The  scores  for  ti  i  s  phase  involve 
the  weapon  release  data.  These  were  the  weapon  release  time, 
slant  range  to  target  at  weapon  release,  down  range,  c ros s- 
range,  and  miss  distance  of  the  weapon  impact  point. 

A  recording  of  the  use  of  zoom  was  kept  during  the  mission 
and  the  number  of  seconds  the  camera  was  zoomed  out  was  re¬ 
corded. 

The  above  variables  were  recorded  for  each  repetition 
(4  repetitions  pe*'  run).  The  error  mean  square  (EMS)  of  these 
values  were  also  calculated  for  the  four  repetitions  in  each 
run.  These  EMS  scores  were  used  mainly  to  detect  consistency 
in  the  targeting  phase  (search  and  attack)  as  the  impact  scores 
were  sometimes  biased  due  to  alignment  of  the  simulator  map 
and  due  to  the  use  of  different  targets  on  different  runs. 

The  data  analysis  was  performed  through  the  use  of  the 
General  Linear  Model  due  to  unequal  numbers  of  observations. 
This  came  about  through  the  subject's  failure  to  hit  target 
at  times,  his  missing  the  target  recognition  button,  and 
programming  parameters  being  mi s-i ni ti al i zed  .  Analysis  was 
also  performed  using  multiple  correlation  techniques  to  try 
to  discover  inter-relationships  between  behavior  variables 
(e.g.  zoom  use,  slew  use)  and  performance  variables  (e.g.  miss 
distance).  A  program  was  written  for  this  purpose  to  enable 
computation  on  multivariate  observations  with  missing  values 
of  some  but  not  all  the  variables. 


APPENDIX  K 
Experiment  IV 

Resul ts 

The  results  of  the  analysis  of  variance  on  the  general 
linear  model  are  shown  in  tables  12  and  13  .  Table  12  lists 

the  results  for  the  actual  variable  values  that  were  recorded 
for  ^ach  repetition.  Here  the  slew  and  zoom  use  measures  are 
not  analyzed  as  they  were  zero  under  certain  conditions. 

Significant  results  on  these  variables  imply  that  there 
were  differences  in  the  actual  performance  of  the  subjects 
under  the  various  conditions.  For  example,  under  "headi ng 
nean'the  availability  or  non-availability  of  zoom  was  signi¬ 
ficant,  In  avor  of  availability  of  zoom.  This  means  that 
when  zoom  was  available  the  subjects  maintained  headings  siqni 
flcantly  closer  to  3G0°.  This  significance  is  not  readily 
interpretable  and  could  be  due  to  random  chance.  See  Appen¬ 
dix  G  for  further  details  on  interpreting  the  tables. 

Table  13  shows  the  results  using  the  square  root  of  the 
error  mean  square  (EMS)  of  the  actual  variables.  EMS  here  is 
a  measure  of  how  much  variation  there  was  of  the  variables 
over  four  repetitions  under  identical  conditions.  In  other 
words,  it  is  a  measure  of  the  consistency  of  subjects  per¬ 
formance  on  the  particular  variable.  Significance  here  im¬ 
plies  a  difference  in  consistency  of  performance  (not  nec¬ 
essarily  better  or  worse)  on  the  referenced  variable.  For 
example,  under  tornet  recognition  slant  range  EMS  there  was 
some  small  significance  with  respect  to  the  zoom  factor.  The 
availability  of  zoom  resulted  in  increased  EMS  on  the  target 


132 


abuey  ssojo 
}oedui  uodean 


c 

o 

Cl  - 
<0  C 

a,  o 

3.  a. 
m 

XI  <JJ 

E  ^ 
3 

l_)  X3 

=  E 

•  3 
C  CD 
C  r 

•r* 

3  C 
d)  c 


c/1  3 

c 

aj 

c 

»— 

Cl 

0  in 

03 

on 

a- 

c  s>- 

yt 

0J  0 
in  on 

4-> 

c 

c 

on 

C  <D 

03 

m 

z*:  in 

E 

h- 

11  11 

l/) 

M 

c  *— 

= 

H- 

h-  h- 

cr 

j- 

c 

0 

•f- 

on 

3: 

c 

<u 

<u 

f— 

00 

<n 

-0 

$- 

<D 

O 

N 

on 

S-  -r- 

c 

O  *— 

a> 

on  *r- 

in 

c  -c 

11 

0J  OJ 
00  4-> 

c 

in 

“C  \ 

a  >> 

X  OJ 

•r* 

Ll_  Q. 
\  00 

0) 

>n-r- 

XJ 

03  O 

o 

r- 

2: 

C-  0 

i/)  "O 

i- 

•r-  3 

0 

Q  4-> 

on 

•r— 

c 

a> 

v 

"O  4-> 

00 

3 

4-> 

•r- 

OJ 

4->  O 

r— 

4->  4-> 

a 

<  c 

on 

>n 

•r- 

c  00 

O 

O 

•r-  4-> 

OJ 

4->  <4- 

xj 

03  03 

3 

c  u 

4-> 

-f-  u 

E 

•r* 

X)  S- 

O 

E  *r- 

O 

4-> 

0  <  ^ 

< 

O 

II  II 

11 

II 

Or- 

< 

A 

A 

Z 

abuey  u<aoq 
;Dedui  uouean 

abuey  }ue[S 
aseatay 
uodean 

aprn  H  LV 
use  a [ay 
uouean 


awij. 

aseatay 

uodean 

iuey  dueis 
•  booay 
}ab-ie± 

auij. 
• booay 
}a6uei 


•AacTPlS 
R-X  LOOloA 


uea^j 

/C^poiaA 


'AacTPlS 
opn; n  IV 


d> 


<TJ  dl 

I-  jQ 
flj  IK 

>  f— 

n  •(— 
<o 
E.  > 
o  <o 
o 

N  E 
O 
O  O 


II  II 
O  r- 


ueatj 
apn^i; tv 


Aaa’p;s 

bu  ipeati 


ueairj 

6u ipean 


m 

m 

in 

m 

m 

in 

in 

cr  • 

OC  CD  • 

on  10  • 

0  0  • 

ID  • 

CO  CO  • 

CO  CO  • 

ro  D  • 

d)  0. 

CD  1 —  C/1 

CO  r—  C/1 

ro  r-  in 

ro  r—  in 

vr  r—  m 

cm  m 

o"i  1—  c/i 

-0  CJ 

O  "  • 

O  *  • 

0  • 

0  »  • 

0  *  • 

0  «  • 

0  -  • 

“O 

•  r- 

•  c\j  zr 

•  1 —  z 

•  cm  zr 

•  CM  ZZ 

•  cm  zr 

uO 

in  ir 

1 — 

ro 

LP 

in 

in 

in 

in 

in 

in 

CM 

•  • 

00  CO  • 

co  co  • 

CO  CO  • 

r—  ID  • 

ro  d  • 

CJ  ID  • 

v£j 

Cn  *—  in 

0  1—  <n 

co  c/i 

CM  r—  m 

ro  »—  in 

ro  r—  in 

0 cr. 

• 

(3  •*  • 

0  -  • 

0  • 

0  -  • 

CM  •*  • 

0  «  • 

0  «  ■ 

cr*  cr> 

.  1—  z 

•  1—  sc 

•  OJ  ZT. 

•  r—  Z 

•  cm  rr 

•  oj  zr 

•  oj  zr 

OJ  OJ 

-0  -0 

m  m 

m 

in 

in 

10 

in 

in 

r—  ro 

LD  CO  • 

co  co  • 

ro  id  * 

ro  id  • 

UO  D  • 

ID  • 

ro  id  • 

0 

CM  r— 

0  *—  m 

in  1—  LT. 

id  »—  in 

in  r—  in 

in  r-  iS 

ID  r—  in 

id  r-  in 

OJ 

^  1^ 

•  •*  . 

0  *  • 

0  •*  • 

0  *  • 

0  •*  • 

t  1  •  • 

0  •*  • 

•  • 

■“  = 

• ^ 

•  CJ  2T 

• » 

•  CM  ZL 

•  CM  2 

-  cm  r 

in 

in 

uo 

in 

in 

UO 

in 

O  »— 

l£>  • 

CD  O  • 

CO  CO  • 

•—  CO  • 

C  4  ID  • 

O  ■ 

Lfl  LC  • 

«t  c 

r—  in 

•cr  1 —  oo 

ro  «—  in 

ro  f—  in 

^  •—  in 

CM  r-  C/I 

r—  r—  l/" 

♦ 

C\J  •  • 

O  *  • 

CM  *  • 

r—  *  ■ 

CO  «  • 

0  « 

l/> 

1 

•  » —  z 

•  1—  z 

r-  CJ  Z 

• » —  z 

•  cm  rr 

•  cm  rr 

•  oj  rr 

CL 

a> 

1 

i- 

IT) 

in 

m 

in 

m 

in 

in 

cr 

I 

co  co  ■ 

cr  id  • 

co  co  • 

•—  CC  • 

ro  0  • 

in  d  • 

CJ  ID  - 

di 

f—  l/) 

f—  »—  Vi 

•—  »—  in 

ro  »—  in 

•—  (/; 

cri  • —  in 

r-  in 

■0 

1 

O  *  • 

O  *  • 

0  *  • 

0  -  . 

0  *  • 

0  »  • 

0  «  • 

•  zz 

•  »—  rr 

•  cj  zr 

• »“  zr 

•  cm  zr 

-  oj  rr 

•  oj  rr 

1 

in 

CM 

1 

c 

C 

c 

• 

CD  CO  • 

00  Lfl  • 

in  uo  • 

•—  in  • 

CO  uo  • 

0  in  • 

CJ  lfl  • 

II 

1 

CD  <—  CD 

on  r—  cO 

0  f—  in 

c  i  1—  in 

ro  r—  in 

r—  1—  in 

<0  r—  U> 

r— 

^  *  • 

»  • 

C\J  -  • 

0  «  • 

OJ  **  • 

r—  •  • 

•*  • 

OM 

1 

■  •—  = 

•  c\j  zr 

• »—  -- 

•  cm  rr 

•  oj  rr 

•  cm  rr 

1 

St 

c 

•  * 

CO 

1 

in  • 

<3  in  • 

CJ  UO  • 

•S’  LD  • 

cc  cn  • 

uo  in  • 

in  in  • 

d 

*3-1 —  i/i 

LO  r~~  L/1 

f—  »—  in 

•d-  1 —  c/i 

1 —  * —  in 

0  <—  co 

CC  C/1 

0) 

1 

f—  • 

10  • 

CJ  *  • 

O  *  * 

r—  •*  • 

r—  *  • 

0  -  • 

L- 

•  • —  zr 

•  r“ 

2 

n 

•  1 —  rr 

•  c  j  rr 

•  oj  rr 

•  oj  rr 

1 

<u 

“O 

1 

CD 

co 

CD 

00 

CD 

00 

CO 

uo  c^i  • 

OO  • 

»—  C\J  • 

r—  CM  • 

cm  • 

0  OJ  • 

r-  cm  • 

dJ 

5 

1 

c 

0 

1—  in 

r-  1—  co 

00  r—  cr. 

00 

r—  C/1 

1—  1/1 

*D 

“O 

r—  •  • 

r—  •*  • 

a  •  • 

0  -  . 

O  **  • 

0  *  • 

O  *  • 

in 

3 

•  . —  7- 

.  • —  ZtZ 

•  oj  zr 

•  r~~  z 

•  cm  rr 

•  oj  zr 

•  oj  rr 

• 

4-> 

it 

•r* 

0 

4-> 

CD 

CD 

ai 

CO 

CO 

CO 

CD 

M 

+-> 

oj  . 

Os}  Os}  • 

CO  OJ  . 

CD  CM  • 

in  cm  • 

UO  OJ  • 

ro  oj  • 

< 

n  c/i 

0  1—  in 

CM  r—  C/1 

Or-  W 

C—  r—  in 

• —  in 

•LT  1 —  c/1 

ID  •*  • 

0  -  • 

O  *  * 

O  **  * 

CM  •*  • 

0  •  • 

f—  «*  • 

XJ 

•  r—  ZI 

.  >—  r* 

•  c\j  rr 

•  r—  rr 

•  cm  rr 

•  oj  rr 

•  cm  rr 

C 

c 

03 

OJ 

a 

CD 

CO 

CO 

cr 

CD 

CC 

CD 

E 

c 

cnj  • 

on  c\j  • 

r—  CM  • 

»—  CM  • 

CD  CM  • 

CM  OJ  • 

cr»  oj  • 

O 

r—  t/n 

an »—  in 

»—  in 

•—  in 

•3"  1 —  C/1 

ro  1—  in 

uo  »—  in 

C 

O 

•  • 

0  •*  • 

0  •*  • 

0  •  ■ 

O  m  • 

0  •  • 

0  *  • 

C 

r^j 

,  77 

.  —  r~* 

•  cm  rr 

ir-  r 

•  cm  rr 

•  oj  zr 

•  cm  zr 

•r* 

T3 

z 

OJ 

OJ 

CD 

CO 

CO 

CD 

co 

CD 

00 

di 

QJ 

C\J  • 

CvJ  • 

f—  CM  • 

CO  CM  • 

CD  OJ  • 

OJ  CM  • 

» —  CM  * 

Z- 

2 

CM  >—  C/1 

f—  in 

f—  in 

OJ  r—  in 

«—  »—  in 

ro  f—  in 

ro  ^n 

4-> 

c^j  •  • 

0  • 

uo  •  • 

0  *  • 

ro  *  • 

ro  •*  • 

, —  +  • 

c 

OJ 

. rr 

•  cm  rr 

•  >—  — 

•  cm  rr 

•  oj  zr 

•  oj  *- 

0 

-Q 

4-> 

CO 

0 

0 

0 

0 

0 

0 

0 

U 

4-> 

CO  • 

c  00  • 

VO  co  • 

O  CD  • 

co  • 

CO  • 

CO  • 

<u 

O 

*3-  I—  </1 

•—  f—  in 

»—  •—  in 

CO  r—  C/1 

d  «—  in 

uo »—  in 

•—  •—  in 

<4- 

OJ 

•*  • 

r-  •  • 

r-  *  • 

*  • 

ro  *  • 

0  •  • 

CM  *  • 

<4- 

4— 

•  . —  -7- 

•  1 —  z 

•  CM  ZZ 

•  r—  rr 

•  oj  zr 

•  oj  rr 

•  cm  rr 

CJ 

CJ 

u 

0 

C 

0 

0  * 

0 

cn 

0 

0 

0 

+-» 

O 

CO  • 

CM  CD  in 

Lf>  CO  • 

OJ  CO  -n 

•T  CO  • 

cr>  00  • 

LD  CD  • 

0 

•r* 

01  r—  1/1 

ini-N 

D  • —  in 

CO  1 —  0 

»—  »—  in 

1 —  C/1 

ro  r—  in 

OJ 

4-> 

O  *  * 

•  •  01 

•  *  # 

•  •  a> 

D  *  • 

in  **  • 

*  • 

'D- 

U 

•  »—  z 

«r  • —  • 

-  cm  rr 

CM  •—  • 

•  OJ  2: 

•  oj  zr 

•  cm  zr 

03 

• 

• 

• 

• 

• 

# 

*  c 

cn 

%-  cn 

%-  o> 

<*-  Ol 

>4-  Cl 

H-  CD 

*l-  cn 

0 

OJ 

•  *r- 

•  *r* 

•  *r- 

•  *r* 

•  •*— 

•  *r* 

•  *r* 

u.  -3  in 

u.  -0  00 

u.  TO  co 

Li-  XJ  CD 

Lc.  "O  C/1 

Ll_  -O  C/) 

u.  D  l/l 

_  4( 

1— 

rM 

(— 

1- 

M 

< 

rvi 

1  (— 

< 

<c 

,VI 

< 

TABLE  i: 

Analysis  of  variance  results  -  Actual  values  from  each  repetition 

133 


I 

a> 

"O 


T3 


c 

ro 

4-> 

* 

O 

M 

03 

* 

a. 

< 

E 

*— * 

• 

cj 

0 

a 

c 

c 

o 

UJ 

fO 

CL 

Nw* 

a 

m 

•r* 

a 

a 

<♦- 

u 

•r- 

*o 

C 

3 

O' 

cr 

•r- 

0 

0 

v 

c 

gr 

tV 

o 

a> 

cj 

“O 

in 

jr 

cj 

03 

cj 

GJ 

t- 

L. 

r— 

o 

U. 

GJ 

t- 

CZ 

U 

U- 

LJ 

c 

c 

GJ 

in 

c 

JZ 

<u 

c. 

4-> 

a; 

03 

u 

O 

M- 

O^ 

Zl 

O 

GJ 

C 

4-> 

o 

o 

•r- 

o 

4-> 

4->  • 

ci 

in 

GJ  CT 

•r- 

o>  O 

GJ 

4-> 

V-  O 

u 

H3 

03  a 

m 

4-* 

H-  Cl 

3 

on 

O' 

i 

l/) 

■ 

Ll. 

i 

in 

1 

4-> 

»— 

on 

3 

UJ 

</> 

_J 

a; 

CD 

i- 

< 

•  HH 

on 

<u 

cc 

s: 

o 

< 

uj  in 

c 

> 

GJ 

*o 

GJ  •— 

•r* 

4->  0 

U 

3  03 

fU 

cj 

O  f- 

> 

u  u 

_a 

C  03 

UJ  > 

O  (~ 

in 

C 

•r* 

•r* 

l/) 

>1-0 

r— 

CJ 

fO 

C 

c 

•r- 

<  <4- 


SW3  9DUBJ 
-sia  ssiu 

CTl  IX)  • 
VO  CO  00 

CO  *  • 

•  f—  z 

vn  vo  • 
vn  co  vn 

co  »  • 

•  i-  z 

10  10  • 
cm  co  on 

r—  •  • 

•  cm  r; 

SU3 

auuey 

ssojo 

un  vo  • 

0(01 /O 

CO  *  • 

•  -  z 

in  id  • 

O  co  on 
o  *  • 

• »-  z 

10  10  • 
m  co  on 
cm  *  • 

•  CM  zz 

sin 

abuey 

UMoa 

0  • 

men  in 
m  •  • 

10  • 

CO  CO  CO 

•  m  • 

«3-  VO  • 

Ci  co  oo 

o  «  . 

•  CM  ZZ 

SU3 

abuey 

;ueis 

OI  VO  • 
vj"  CO  (/) 
fv.  »  • 

m  10  • 
cm  co  on 
lT)  *  • 

CM  10  • 

CC  CO  00 

vo  •  • 

•  CM  ZZ 

ap 

sm 

rUPLV 

vn  vo  • 
o  co  oo 

N  •  • 

vr  vo  • 

O  CO  00 

1  *  1 

vo  vo  • 
oi  co  oo 
o  *  . 

■  cm  zz 

sin 

aiun 

CM  VO  • 
r-coio 
N  *  • 

CO  VC  • 
OfOl/i 
•  •  • 

m  0  • 
co  co  oo 

*  • 

•  cm  n 

sin 

abuey 

lueis 

o>  CO  • 

cm  co  on 

o  *  • 

CO  * 

CO  CO  10 
.  *CT> 

r—  • 

co  • 
10  cn  on 
m  •  • 

•  CM  ZZ 

sm 

auu 

co  co  ■ 
co  co  vn 
o  *•  • 

ci  co  ■ 
co  oo 
o  •  • 

cm  cn  • 
^  cn  on 

r-  •  • 

•  CM  ZZ 

A 

ueayj 

poiaA 

cm  on  • 
uo  cm  on 
on  •  • 

10 

CO  CO  • 
»—  cm  on 

cn  cn  • 
cm  cj  on 

CM  *  • 

•  CM  ZZ 

ueayj 
aprn  p  iv 

co  • 

r-  CM  On 

o  *  • 

10  co  • 
m  cm  on 
in  *  • 

cm  cn  • 
i0  cm  on 

CM  •  • 

•  CM  ZZ 

ueaw 
bu  ipeatj 

vf  VO  • 

incoi/i 

CO  «  ■ 

00  VO  • 
tv.  CO  00 

o 

cn  i0  • 
cn  cn  on 

r-  •  • 

•  CM  ZZ 

uo  hb  MBA 
oojnos 

< 

M 

»— 

* 


m  i0  • 

r— 

10  * 

10  • 

10  • 

cn  on 

o 

cn  cm 

o  oo  OO 

** 

on  on 

CM  *  • 

• 

•  oo 

10  •  • 

10 

•  r-  zz 

CM 

CM  • 

•  CM  ZZ 

• 

CM  ZZ 

10  • 

«3-  VO  • 

VO  • 

0 

VO  • 

i— 

co  oo 

t—  on  on 

cm  on  on 

CM 

cn  0 

• 

o 

» 

*3-  •  • 

•  • 

• 

•  • 

E 

•  CM  ZZ 

•  CM  ZZ 

r~~ 

CM  ZZ 

o 

o 

N  • 

* 

c 

VO 

VO  • 

«3"  VO  -K 

on  0  • 

cn 

0  • 

sz  o 

r— 

cn  on 

r—  on  on 

o  cn  on 

o 

cn  0 

4->  -r- 

CM 

• 

•  *  CO 

cn  •  • 

cn 

•  • 

•r-  4J 

• 

»—  zz 

cm  on  . 

•  CM  ZZ 

• 

CM  ZZ 

S  O 

(V 

C  i~ 

O  OJ 

cn 

VO  • 

cn  vo  • 

10  0  • 

0 

VO  • 

•r-  4-» 

VO 

cn  on 

0  on  on 

cm  cn  on 

cn 

cn  0 

+->  c 

• 

r—  •  • 

•  • 

•  • 

ro  *r* 

• 

i—  z 

•  CM  ZZ 

•  CM  ZZ 

• 

CM  ZZ 

•r* 

* 

^3  h— 

* 

>  < 

cn 

VO  • 

CM  0  • 

tv  VO  * 

r— 

VO  . 

- - - 

r— 

cn  on 

cm  on  on 

i—  cn 

CO 

0  0 

at 

r— 

• 

•  • 

•  » CO 

• 

*  • 

i. 

• 

•—  CJ  zz 

CJ  CM  • 

cm  rr 

O  in 

n  ic  • 

* 

1—  c 

* 

* 

.  o 

CM 

VO  • 

VO  vo  * 

CO  vo  * 

f— 

VO  • 

4->  1  *r* 

^3" 

CO  00 

•—  co  vn 

CO  CO  vo 

cn 

co  oo 

<4-  +-> 

•  • 

•  *cr» 

.  »C0 

• 

«  • 

cr.  o 

• 

■vr  cm  • 

CM  CM  • 

2 

H 

163*; 
nti  n 
tera 

CO  • 

cm  on  • 

•—  on  • 

CM 

0  • 

3  C 

co  oo 

rv  co  oo 

on  on  on 

co  oo 

II  O  -r- 

»— 

•  • 

CJ  •  • 

•  • 

cn 

•  • 

r— SI 

• 

r—  Z 

•  CM  ZZ 

•  CM  ZZ 

• 

CM  ZZ 

M  ^-NN 

t-  1- 

••CM 

•  l/>  ' — 

CM 

cn  • 

co  co  • 

rn  on  • 

CM 

0  • 

+J  c 

r^. 

cn  on 

c*.  on  on 

on  on  on 

CO 

0  0 

<4-  OI 

cn 

• 

o  •  • 

in  •  • 

cn 

•  • 

•  0  in 

• 

•  CM  ZZ 

•  CM  ZZ 

• 

CM  ZZ 

ro  nr 

O  OI  t~ 
r^.  to  i 

3  E 

cn  • 

c ri  on  • 

i  on  • 

CO 

0  • 

II  *>  o 

~D 

CM  00 

r-  CM  on 

•—  cm  on 

o 

CM  0 

o-<-  o 

O 

• 

»—  w  • 

i—  •  • 

cn 

•  • 

N  4-1  N 

• 

i—  zz 

•  CJ  ZZ 

•  cm  zr 

• 

CM  ZZ 

1  *•-> 

OI  <  V- 
cn  o 

* 

C  V  V- 

CM 

on  • 

CO  CO  * 

on  on  • 

0  • 

<o  O 

vo 

CM  00 

CM  CM  vo 

i—  CM  00 

CM 

CM  0 

CC  <4- 

o 

•  • 

•  *  CO 

CM  •  • 

• 

•  • 

CM  CM  • 

•  CM  ZZ 

cm  zr 

4-> 

c 

<0  at 

on 

«—  at  >— 

cn 

vo  • 

un  0  • 

i—  vo  • 

0 

0  • 

OO  >—  3 

cn  on 

vn  co  oo 

3  CO  00 

0 

0  0 

3  (t) 

CM 

• 

3  «  • 

•  •  • 

r— 

• 

00  «  h 

• 

*“  zz 

•  CM  ZZ 

•—  CM  ZZ 

• 

CM  ZZ 

ZZ  h- 
UJ  CJ 

at  at 

C  GJ  0 
(V  0 

i— 

at  -tc 

M 

1— 

1— 

OJ 

2:  *  * 

< 

M 

< 

*  *  * 

release  slant  range  (i.e.,  more  variation).  This  does  not 
imply  that  the  subjects  did  better  with  zoom  or  worse  with¬ 
out  it.  It  does  mean  that  the  subjects  were  more  consistent 
on  target  release  slant  range  (consistently  good  or  consis¬ 
tently  bad)  without  zoom  than  with  zoom  (Note:  No  difference 
observed  in  miss  distance). 

Using  the  actual  variables  generated  only  two  significant 
results.  These  were  for  zoom  on  heading  mean  (see  above)  and 
minor  significance  on  weapon  release  altitude  with  the  slew/ 
weapon  task  factors.  There  was  a  tendency  to  release  the 
weapon  at  a  higher  altitude  under  Task  3  which  was  the  "smart" 
bomb  with  slew.  For  the  EMS  variables  there  were  several  sig¬ 
nificant  results.  Most  of  the  significance  was  with  second 
degree  interaction  of  task  and  the  other  two  factors.  Table 
14  shows  this  interaction  in  detail.  It  may  be  noted  that 
the  re  exists  strong  similarity  in  this  interaction  across  the 
respective  variables.  This  similarity  demonstrates  a  decrease 
in  consistency  (higher  EMS's)  from  Task  1  to  Task  3  with  the 
combination  attitude  di spl ay/f i xed  camera  mode  but  an  increase 
in  consistency  (decrease  in  EMS)  from  Task  1  to  Task  3  with 
the  aircraft  symbol  attitude  di spl ay/ stabi 1 i zed  camera  mode. 
This  trend  can  be  seen  in  three  variables  with  significant, 
or  near  significant,  interaction. 

There  were  some  near  significant  interactions  with  the 
zoom  factor  and  the  task  factor  (See  Table  15  ).  There  is  a 
similarity  across  dependent  variables  here  but  not  as  pro¬ 
found  or  strong  as  that  noted  between  the  di spl ay/ sensor 
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TABLE  14 


Breakdown  of  Interaction  between  the  attitude  di spl ay/sensor 
node  factor  and  the  slew/weapon  factor.  Tables  contain  aver¬ 
age  values  of  EMS  of  variables  under  the  different  factor  con¬ 
ditions. 


Altitude  Mean 

EMS 

Weapon 

Release  Time 

EMS 

Ao 

A1 

\ 

A1 

\ 

lb. 9  ft. 

30.3  ft 

To 

3.13  sec . 

3.84 

sec . 

Ti 

26.7  ft. 

31.4  ft. 

T1 

2 .69  sec . 

3.12 

sec . 

T2 

36 . b  ft. 

10.3  ft. 

T2 

4.43  sec. 

1.36 

sec . 

Down 

Range  EMS 

Miss  Distance  EMS 

Ao 

A1 

Ao 

A1 

To 

670  ft. 

1224  ft. 

To 

374  ft. 

1200 

ft. 

T1 

490  ft. 

1110  ft. 

T1 

307  ft. 

967 

ft. 

T., 

c 

109b  ft. 

373  ft. 

T2 

004  ft. 

321 

ft. 

136 


TABLE  15 


Breakdown  of  interaction  between  zoom  factor  and  task  factor. 
Tables  contain  average  EMS  values  of  the  variables  under  diff¬ 
erent  factor  conditions. 


Weapon  Release  Time  EMS  Weapon  Release  Altitude  EMS 


Zo 

Z1 

Zo 

Z1 

To 

3.92 

sec. 

3.06 

sec . 

To 

267  ft. 

212 

ft. 

T1 

2.56 

sec. 

3.15 

sec. 

T1 

234  ft. 

262 

ft. 

T2 

2.20 

sec. 

4.10 

sec. 

T2 

186  ft. 

335 

ft. 
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mounting  mode  factor  and  the  task  factor.  Here  the  availa¬ 
bility  of  zoom  tended  to  make  for  more  consistency  on  Tasks 
1  and  2  and  less  consistency  on  Task  5.  Without  zoom  this 
relationship  tended  to  reverse  with  more  consistent  per¬ 
formance  on  Tasks  2  and  3  and  less  consistency  on  Task  1. 

Table  16  shows  the  various  performance  measures  for  the 
individual  subjects.  This  table  includes  the  mean,  standard 
deviation  and  number  of  valid  observations  for  the  variables 
for  all  runs  per  subject  and  for  all  subjects.  Correlations 
were  calculated  between  all  these  variables  and  the  run  num¬ 
ber  and  repetition  number  to  try  to  detect  any  overall  learn¬ 
ing  (i.e.,  improvement  of  scores  with  experience)  in  the  sinu 
lation.  These  correlations  are  shown  in  Table  1?  . 

The  only  significant  (.95  level  of  significance)  correla¬ 
tion  was  between  run  number  and  weapon  release  time.  The 
positive  correlation  here  indicates  that  the  subjects  tended 
to  release  the  weapon  in  the  mission  as  the  experiment 

progressed . 
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TA3LE  16 

Performance  measures  for  individual  subjects  and  all  subjects  for 
various  variables. 
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ANALYSIS  OF  WITKIfl  EMBEDDED 
FIGURES  TEST  SCORES  FOR  EXFRPIUFflT  II 

The  object  of  this  analysis  is  to  determine  if  a  positive 
relationship  exists  between  error  scores  and  Embedded  Fin- 
ures  Test  scores  under  the  conditions  of  contradictory  dis¬ 
play  formats.  This  analysis  was  accomplished  as  an  additional 
exploratory  study  since  data  was  available.  The  formats  that 
were  considered  were  as  follows: 

Phase  1  - 

1.  Aircraft  symbol  (behaves  like  artificial  horizon, 
inside-out)  and  stabilized  TV  camera 

2.  ADI  (inside-out)  and  stabilized  TV  camera 

3.  ADI,  aircraft  symbol,  and  stabilized  TV 
Phase  2  - 

1.  Aircraft  symbol  (outside-in)  and  fixed  TV 
camera  (inside-out) 

2 .  ADI  and  stabi 1 i zed  TV 
Phase  3  - 

1.  Aircraft  symbol  (outside-in)  and  fixed  TV 

2.  Artificial  horizon  (inside-out)  and  stabilized  TV. 
Considerinq  that  different  phases  of  the  experiment  were 

not  performed  under  homogenous  conditions,  direct  e^rnr 
scores  could  not  he  used  for  the  correlation  analysis.  To 
avoid  this  problem  and  still  utilize  all  suhiects  in  the 
analysis,  individual  scores  were  normalized  within  each  phase. 


Normalized  scores  were  then  ranked  over  all  subjects  with 
the  EFT  Scores  (See  Table  7).  The  Snearman  Rank  Correla¬ 
tion  Coefficient  was  then  calculated  between  EFT  ranks  and 
each  variable  and  also  between  FFT  and  the  averane  rank  over 
all  variables. 

As  can  he  seen  on  Table  7,  no  siqnificance  was  reached 
althouqh,  as  hypothesized,  there  was  a  definite  tendency 
towards  positive  correlation  since  all  variables  had  positive 
correlations  with  the  EFT  Scores.  This  indicated  that  possi¬ 
bly  under  more  strinqent  test  conditions  with  a  larqer  number 
of  subjects  and  with  a  parametric  multivariate  test  statistic 
(such  as  the  multiple  correlation  coefficient)  a  slqnlflcant 
positive  relationship  would  appear.  Additionally,  It  must 
be  noted  that  as  a  group  pilots  exhibit  definite  Field  Inde¬ 
pendent  behaviors  (Cullen,  1969).  Since  only  pilots  were 
used  as  subjects  In  this  study,  EFT  scores  elicited  were  all 
below  published  norms.  Differentiation  was  thus  accomplished 
with  persons  who  all  exhibit  Field-Independent  abilities; 
therefore,  to  obtain  siqnlficant  differences  in  behavior  alonq 
the  1/itkin  continuum  would  be  a  more  strinqent  task. 
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TABLE  lfi 

CORRELATION  ANALYSIS  FOR  EFT  SCORES 
TABLE  18A 


Ranking  of  Subjects  with  Respect  to 
the  Normalized  Error  Scores  and  EFT 


VARIABLES 


Sub-  Pitch  Roll 


ject 

No. 

Phase 

Rever¬ 
sal  s 

Rever¬ 

sals 

Res  p . 

T  i  ne 

Correct 

Move 

Compi . 
T  ire 

Acf  t. 
Move 

Av. 

Rank 

EFT 

1 

I 

9 

2 

9 

8 

3 

8 

6.5 

3.5 

2 

I 

2 

0 

1 

3 

8 

3 

4.17 

1 

3 

II 

5 

7 

6 

10 

6 

10 

7.3 

5 

4 

II 

8 

6 

5 

6 

2 

2 

4.83 

9 

5 

II 

3.5 

4.5 

4 

1 

10 

6 

4.83 

8 

6 

II 

3.5 

4.5 

8 

5 

4 

4 

4.83 

2 

7 

III 

6.5 

1 

3 

4 

5 

5 

4.083 

6 

8 

III 

6.5 

9.5 

7 

7 

7 

o 

7.67 

10 

9 

III 

1 

3 

2 

O 

c 

1 

1 

1.67 

3.5 

10 

III 

10 

9.5 

10 

9 

9 

7 

9.1 

7 

TABLE  18B 

Spearman  Rank  Correlations  with  EFT  Scores 


Vari able 


>"s  Significance* 


Pitch  Reversals 

.5 

N.S. 

Roll  Reversals 

.306 

N.S. 

Response  Tine 

.221 

N.S. 

Time  to  Correct 

Movement  .179 

N.S. 

Completion  Tine 

.227 

N.S. 

Aircraft  Movement  .306 

N.S. 

Average  Rank 

.536 

N.S. 

*An  r$  of  .56  is 

significant  at  the 

. 95  level  . 
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LTi  CO  C\i  KD 


GLOSSARY 


Fz  Downward  Force  (lb) 

3 

p  Atmospheric  Density  (slug/ft  ) 

M  Vehicle  Mass  (slug) 

CzQ  Normal  Force  Coefficient  at  Zero  Angle  of  Attack 

U  Forward  Body  Component  of  Velocity  (ft/sec) 

V  Sideward  Body  Component  of  Velocity  (ft/sec) 

W  Downward  Body  Component  of  Velocity  (ft/sec) 

2 

S  Reference  Area  (ft  ) 

CZa  Normal  Force  Coefficient  Slope  with  Angle  of  Attack 
(1/rad) 

Fx  Forward  Force  (lb) 

F^  Sideward  Force  (lb) 

Tmax  Net  Maximum  Thrust  (lb) 

6 ^  Per  Cent  of  Maximum  Thrust 

CXQ  Body  Drag  Force  Coefficient  at  Zero  Angle  of  Attack 

CXa  Body  Drag  Force  Coefficient  with  Respect  to  Angle  of 

Attack  (1/rad) 

CXq2  Body  Drag  Force  Coefficient  with  Respect  to  Angle  of 

2 

Attack  Squared  (1/rad  ) 

Cyg  Side  Force  Coefficient  due  to  Sideslip  Angle  (1/rad) 

M  Roll  Moment  (ft-lb) 

x 

My  Pitch  Moment  (ft-lb) 

Mz  Yaw  Moment  (ft-lb) 

c  Mean  Aerodynamic  Chord  (ft) 


b  Wing  Span  (ft) 

2 

I  Roll  Moment  of  Inertia  (slug-ft  ) 

x  2 

I  Pitch  Moment  of  Inertia  (slug-ft  ) 

y  2 
I  Yaw  Moment  of  Inertia  (slug-ft  ) 

2 

c  Pitch  Moment  Coefficient  with  Respect  to  Angle  of 

ma 

Attack  (1/rad) 

C  Pitch  Moment  Coefficient  with  Respect  to  Elevator 

m6e 

Oe fleet  ion  (1/deg) 

C  Pitch  Moment  Coefficient  with  Respect  to  Pitch  Rate 

mg 

(1/rad/sec) 

C,  Roll  Moment  Coefficient  with  Respect  to  Sideslip 

lb 

Angle  (1/rad) 

C  Roll  Moment  Coefficient  with  Respect  to  Roll  Rate 

IP 

(1/rad/sec) 

r  Aileron  Effectiveness  (1/deg) 

1  6a 

C  Yaw  Moment  Coefficient  with  Respect  to  Sideslip 

nB 

Angle  (1/deg) 

C  Yaw  Moment  Coefficient  with  Respect  to  Yaw  Rate 

nR 

(1/rad/sec) 

C  Rudder  Effectiveness  (1/deg) 

n6r 

2 

g  Gravity  (32.17  ft/sec  ) 

p  Roll  Rate  (rad/sec) 

Q  Pitch  Rate  (rad/sec) 

R  Yaw  Rote  (rad/sec) 

t  Yaw  Angle  (rod) 

e  Pitch  Angle  (rad) 


i  4  5 


♦  Roll  Ang 1 e  ( rad ) 

X  Northern  Velocity  Component  (ft/sec) 

• 

Y  Eastward  Velocity  Component  (ft/sec) 

• 

H  Rate  of  Climb  (ft/sec) 

6e  Elevator  Deflection  (deg) 

*a  Aileron  Deflection  (deg) 

Rudder  Deflection  (deg) 

6PITCH  Forc  and  Aft  Center  Stick  Deflection  (%) 

<5R0LL  Steward  Motion  of  the  Center  Stick  (%) 

^  YAW  Rudder  Pedal  Deflection  (%) 

s  LaPlace  Transform  Operator  (1/sec) 

^COMMAND  Yaw  Camera  Command  (deg) 

°C0MMAND  Pilot  Pitch  Camera  Command  (deg) 

'‘'CAMERA  Camera  Yaw  Angle  with  Respect  to  the  Vehicle 
(deg) 

eCAMERA  Camera  Pitch  Angle  with  Respect  to  the  Vehicle 
(deg ) 

^CAMERA  Camera  Roll  Angle  with  Respect  to  the  Vehicle 
(deg ) 

t$  Smoothing  Time  Constant  (sec) 

Hy  Apparent  Camera  Altitude  (ft) 

Z  Zoom  Ratio 

Xy  Apparent  Camera  X  Position  (ft) 

Yy  Apparent  Camera  Y  Position  (ft) 

X  Vehicle  Northward  Position  (ft) 

Y  Vehicle  Eastward  Position  (ft) 

H  Vehicle  Altitude  (ft) 
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